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Executive Summary 



Why some faculty produce research year after year and 
others do not is a 1 1 puzzle 1 ' (Cole, J. and Zuckerman 1984). 
Despite at least 90 studies since 1940 (Fox 1983), the mea- 
sures of research performance are vague and pooriy under- 
stood. Researchers do not clearly identify explanations for 
high research performance. The specific correlates of high 
performance are fraught with measurement problems, 
unclear causality, and unspecified predictive power. More- 
over, the results from empirical studies are not translated 
into practical use for the resolution of such faculty issues 
as faculty development and faculty evaluation. 

This study reviews the literature on faculty research per- 
formance, it examines the measures of performance, the 
explanations and specific correlates likely to influence high 
research performance, and the practical implications of 
empirical studies for faculty development and evaluation. 
Only individual faculty research is discussed; analyses of 
research performance by departments, colleges, and insti- 
tutions are available elsewhere. Further, only 1 'research" 
is examined, acknowledging that faculty engage in impor- 
tant service and teaching activities as well as research. 
Finally, this study reviews results reported about science 
and social science faculty as discussed primarily in the lit- 
erature on sociology and the sociology of science, recog- 
nizing that faculty in the arts, humanities, and other disci- 
plines also engage in valuable research activities. 

How is research performance, especially high performance, 
measured? 

Few writers specifically ^scuss alternative measures of 
research performance, and few identify their conception of 
research or that of their respondents (Finkelstein 1984). 
Even attempting to measure faculty performance disturbs 
some people who consider it unmeasurable (Yuker 1978). 
Still, data-based studies of science and social science fac- 
ulty use three common measures: publication counts, cita- 
tion counts, and peer-colleague ratings. 

Publication counts, which measure the quantity of an 
individual's output, are obtained by simply counting the 
number of publications ("straight count 1 ') or by counting 
the number of publications using a weighted scale for each 
type of publication ("weighted count"). "Publications" 
often include articles published in scholarly journals and 
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books and monographs. Publication counts may have lim- 
ited accuracy because they give equal credit to poorly con- 
ceived papers appearing in badly edited journals as well as 
to well-written papers in quality journals (except when a 
"weighted" scale of quality is used). In addition, publica- 
tion counts do not consider such factors as coauthorship 
and the length of published works. 

Citation counts, which measure the quality of a publica- 
tion and its influence on academic knowledge and the aca- 
demic community, are obtained by couming citations 
reported in published indices, such as the Science Citation 
Index (SCI) the Social Science Citation Index (SSCI), and 
the Arts and Humanities Citation Index. Information in 
these indices reports the number of times an individual's 
publications are cited. Through the published indices, 
researchers can easily and objectively trace a faculty mem- 
ber's research record. However, citation counts may 
reflect fads in citing popular works and may not accurately 
show the precise impact of a published work. Other prob- 
lems are inherent in published indices, such as citing works 
by the first author only. 

Peer or colleague ratings, which measure the reputation 
of a scholar or researcher in the academic community 
(Cole, J. 1979), are obtained from questionnaires, letters, 
or interviews. Ratings often include an assessment of the 
perceived quality and visibility of an individual's work. 
They are widely used in evaluating faculty performance for 
promotion and tenure. Ratings may accurately portray per- 
formance because peers know the researcher's work and 
feel qualified to compare it with that of others (Pelz anc' 
Andrews 1966). However, they may also provide inade- 
quate or false information, reflect the "halo" effect of a 
scholar's employing institution, and be inconsistent when 
made by several peers. 

What explains why some faculty become high research 
producers (or prolific producers) and others do not? 
Evidence shows that (he average rate of faculty publication 
tends to be low and the variation in performance very high 
(Fox 1983). Writers explain this variation in several ways 

Productive researchers possess certain psychological 
and individual characteristics that are absent in less pro- 
ductive researchers. High producers may have "innate" 
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scientific ability or talent, possess a "sacred spark" of 
motivation and desire, and have a certain type of personal- 
ity or cognitive structure. Biographical studies of eminent 
scientists reveal hard-working people who play with ideas, 
recombine familiar concepts easily, and tolerate ambiguity 
and abstraction (Fox 1983;. High producers also tend more 
often to be men than women, and they sustain high perfor- 
mance levels throughout their careers. 

Productive researchers cumulate advantages during 
their careers, such as training in a prestigious graduate pro- 
gram, employment in a najor research university, and the 
availability of adequate resources for research. 

Productive researchers are reinforced in their research 
efforts by colleagues' citing and praising their works, and 
by having their works accepted for publication early in 
their careers. According to one author. 

Unless a person achieves a qualitative piece of research 
during his first five years as a sociologist . . . it seems 
unlikely that he will do so during the next five years— if 
at any time during his career (Lightfield 1971, p. 133). 

Productive researchers are shaped and molded by the 
norms of their discipline to publish in select outlets and to 
engage in specific research activities. For example, in dis- 
ciplines in which knowledge is highly codified and individu- 
als agree on important questions and methods (e.g , phys- 
ics), faculty publish more in journals (an abbreviated form 
of communication) than in books (an extended form of 
communication) (Gaston 1978). 

What specific correlates (or factors) influence high research 
performance? 

Researchers have tested the general explanations of high 
research performance using a complex set of correlates. 
Evidence supgests that sociological and work-environment 
con elates (e.g., amount of time spent on research) may 
explain performance more precisely than psychological 
correlates (e.g., I.Q.). The impact of a correlate, however, 
seems highly related to the type of measure (e.g., journal 
articles versus books) and the discipline being studied. 

Still, from numerous correlate studies in the past 40 
years, a profile of pi niuctive researchers has emerged. A 
productive researcher— 
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• is employed in a major university that rewards 
research and assigns ample time for faculty to conduct 
research; 

• holds senior professorial rank, though performance 
may peak 10 years after the doctorate and again later 
toward the end of a career; 

• spends at least one-third of time on research activit'es; 

• began publishing early in career and received positive 
feedback from peers for research efforts (Cole, J. and 
and Cole, S. 1973); and 

• maintains regular and close contact (e.g., telephone 
calls) with colleagues on and off campus who conduct 
research on similar topics. 

What are the implications of the literature on research 
performance for faculty development, faculty evaluation, 
and future research? 

The literature on research performance can inform faculty 
and academic administrators about strategies for develop- 
ing faculty as researchers and for evaluating faculty perfor- 
mance. Traditional literature on faculty development sug- 
gests that faculty can develop as researchers by taking sab- 
batical leaves, attending professional meetings, and 
securing funds for projects. The correlate studies present 
additional strategies. Graduate students can select out- 
standing graduate programs for their training. Faculty can 
begin publishing soon after graduation, maintain a continu- 
ous level of research throughout their career, keep in con- 
tinuous contact with other scholars working on similar 
projects, and establish a preference for and time for 
research in their work schedule. Administrators and fac- 
ulty commit f ees can reinforce and stimulate faculty 
research by employing graduates of quality programs, pro- 
moting and tenuring faculty who are productive research- 
ers, providing faculty with time and resources to conduct 
studies, and creating an attitude and atmosphere in a 
department or a college that values research. 

In the faculty-evaluation process, faculty and personnel 
committees should recognize that research performance 
varies by discipline and the stage of a f aculty career and 
that multiple measures of research performance should be 
used in assessing "search effort. Further, when publica- 
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tion counts are used, they cm be supplemented by a quali- 
tative index of publications. 

Future research studies should include (a) using criterion 
measures in addition to publications, citations, and ratings 
(e.g., number cf patents^; (b) tests of explanations of per- 
formance based on an interdisciplinary approach; (c) tests 
of models in which academic rank, institution, discipline, 
and career age are he'd constant so that substantive work- 
environment correlates can be examined; and (d) continued 
efforts to examine i\ e practical implications of the litera- 
ture on research peuormance. 
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FOREWORD 



In the next decade, the percentage of tenured faculty at 
colleges and universities will rise, to include perhaps more 
than 75 percent of all available positions. Many of these 
tenured slots are already held by distinguished professors 
who achieved their senior rank at a relatively j oung age 
and who will remain productive for at least another 
decade. What can administrators do to improve or main- 
tain scholarly productivity during the different phases of a 
professional career? What is known about productive and 
non-productive performers? What steps can an institution 
or department take to create, enhance, and promote pro- 
ductivitv? 

These are the issues addressed in this ASHE-ERIC 
report, the fourth in the 1985 series. Although teaching is 
and will remain the primary function for the majority of all 
faculty, the subject of research performance will have a 
marked influence in determining the face of academe 
tomorrow. 

When judgments are made regarding a faculty member's 
worth to an institution, research or scholarly performance 
and productivity v/ill play an increasingly important role. 
An institution whose search committees and tenure review 
committees oest judge tomorrow's high producers will 
prosper more easily than others. Just as important, the 
institution that can create an atmosphere that encourages 
faculty members to remain productive throughout their 
careers will measurably improve their stature in the profes- 
sional community. As this report shows, the ability to 
attract top-flight talent will be wasted if the school environ- 
ment is not conducive to high performance. High research 
performance is already admired and desired throughout the 
institutional structure. Scholarly productivity enhances a 
faculty member's teaching ability by providing better 
insight to the discipline and contributing to the latest devel- 
opments. Presidents and trustees value productivity for the 
visibility and reputation it indirectly earns for the institu 
tion. Administrators and deans admire productivity for the 
creative, stimulating forces it brings irf o the collegial atmo- 
sphere. The academic community smiles u;\>n scholarly 
work because it advances km wledge. 

Perhaps no one benefits mo;e from publishing than the 
researchers themselves. The objective display of one's 
work in a critical atmosphere can lead to sharper scholars, 
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more adept teachers, and better communicators. If nothing 
else, an author receives a great boost of self-confidence at 
seeing his or her work published. At research-oriented 
institutions, 'publish or perish' is more than a slogan; it is 
the wheel about which the success of a;; institution, and 
each individual in it, revolves. 

Although ths importance of high research performance is 
understood, what is not so readily accepted is the defini- 
tive, preferred method of gauging productivity. Which is 
more useful in establishing the total output of a faculty 
member — publication counts or citations? Which is the 
more important contribution within a discipline — a book or 
a journal article? What should be weighed more heavily in 
determining a scholar's value — peer reviews or profes- 
sional reputation? How should publications data be col- 
lected — self-reporting or surveys of bibliographies and 
databases? In attempting to unravel the answers to these 
and other questions, John Creswell, associate professor of 
education at the University of Nebraska, analyzes th : 
research findings on faculty productivity and examines the 
methodology of evaluating faculty research performance. 
He explores the common factors among high research per- 
formers to identify the causes for the wide variance in 
scholarly performance among faculty members. 

The significance of this ASHE-ERIC report is its empha- 
sis of the crucial role that the institutional environment 
plays in allowing those so inclined to be productive. Devel- 
oping the proper atmosphere on a campus is not beholden 
to financial considerations or extensive studies. Any insti- 
tution is able to schedule research time into each member's 
schedule, to offer positive reint jrcement informally at fac- 
ulty meetings or formally with a publications party, to 
encourage creative and curious minds to follow their ideas 
vith research. Productivity cannot be artificially created by 
an institution. But an oppressive climate will snuff out the 
spark of productivity every time. This is the administrative 
challenge for tomorrow. 

Jonathan D. Fife 

Series Editor 

Professor and Director 

ERIC Clearinghouse on Higher Education 

The George Washington University 
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INTRODUCTION 



Mcsi college and university professors in the United States 
do not think of themselves as researchers. Faculty describe 
themselves primarily as teachers and engage mainly in 
teaching (Fulton and Trow 1974). Over half of American 
professors have published nothing or very little (Ladd 
1979). Still, research is a valued activity in postsecondary 
education. Whether or not faculty themsei, lage in 
research, they seem to believe that a most important activ- 
ity for an academic is the performance of significant 
research (Ladd 1979). And research is no longer the pre- 
rogative of doctorate-granting institutions and major uni- 
versities; state colleges and liberal arts schools have begun 
to stress research, publications, and involvement in profes- 
sional societies (Seldin 1984b). 

Several compelling reasons exist for faculty to engage in 
research. Faculty research brngs state, regional, and 
national visibility to academic institutions. It becomes a 
means whereby an institution can establish a reputation for 
outstanding faculty and demonstrate achievement and 
progress to the public (Meisinger, Purves, and Schmidtlein 
1975). Faculty research lends an element of objectivity to 
the promotion and tenure processes when it can be codified 
and included on a vita go that peers can review it easuy 
(Ladd 1979). Research also contributes to public knowl- 
edge by developing a rational consensus in fields of study 
with burgeoning scholarly and technical journals and books 
(Carnegie Council on Policy Studies in Higher Education 
1980;Ziman 1968). 

The value of resea t ch on college and university cam- 
puses is understood by those working on the campuses. 
Less clear is how f aculty perform at research. For exam- 
ple, few writers specifically discuss alternative measures of 
research performance, and few identify their conception of 
research or that of their respondents (Finkelstein 1984). 
Even attempting to measure faculty perfoimance disturbs 
some who consider it unmf durable (Yuke: 1978). And yet, 
writers studying research performance use common crite- 
rion measures. Faculty personnel committees make judg- 
ments about a candidate's credentials based on select mea 
sures. 

Faculty vary in their research performance levels (Alli- 
son 1980). Why some faculty become major research pro- 
ducers year after year and others do not is a "puzzle" 
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(Cole, J. and Zuckerman 1984). Writings in sociology, psy- 
chology, and social psychology provide tentative solutions 
to the ' 'puzzle.' ' Specific factors — correlates — associated 
with high productivity have been widely discussed since 
1940 in the literature on the sociology of science. Jonathan 
Cole and Zuckerman (1984) cited 40 studies published 
since 1975. Fox (1983) summarized approximately 90 stud- 
ies. From these works and others, researchers can assem- 
ble a composite picture of productive research facuUy. 

That picture, though, is *n abstract image. Important 
piactical implications seem apparent from the studies, 
especially for faculty development and evaluation, but 
researchers infrequently discuss them. This may be due to 
the dominance of theoretical, data-based studies in the lit- 
erature. It may also be a commentaiy on the current state 
of the art of research. Regardless of the reason, a need 
exists to bridge the empirical literature on research perfor- 
mance and the applied literature on faculty. 

Background 

Early studies examining faculty research performance 
began in the 1940s and 1950s .ien writers first studied 
"faculty" in higher education. Logan Wilson's (1942) 
sociological study, The Academic Man, is a good case in 
point. In a comprehensive study of many aspects of aca- 
demic life, Wilson touched on research productivity in a 
review of how academics spent their time. He found teach- 
ing to be the primary occupation of faculty; research was 
of little importance, especially in performance appraisals. 
Wilson's observations supported the conclusion that the 
person who published research, or creative or interpreta- 
tive writing, was not promoted as rapidly as the person 
who confined his or her activities to classroom teaching. 

In another study of faculty approximately 15 years later, 
Lazarsfeld and Thielens (1958) examined social scientists 
who were high producers. High research producers— indi- 
viduals who published dissertations, papers, and books and 
who read papers at professional meeti* & s — were officers in 
professional organizations, moved from institution to insti- 
tution, and often came from high socioeconomic families. 

In the late 1950s, practical reasons developed for the 
study of faculty in higher education. In the post-sputnik 
era, researchers collaborated with others in federally and 
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privately funded research laboratories. Policymakers 
became concerned about maximum research performance 
in the laboratories and the effects of the research environ- 
ment on scientific performance (Kaplan 1964). Funded by 
the National Institutes of Health and the Carnegie Corpo- 
ration of New York, Pelz and associatf s at the University 
of Michigan began a six-year study with the question, 
"What constitutes a stimulating atmosphere for research 
and development? 1 1 (Pelz and Andrews 1966, p. 1). Includ- 
ing Ph.D.'s in research laboratories in universities in their 
sample, they addressed their research to those factors 
associated with high research performance, such as moti- 
vation, communication, age, and freedom. As a result, 
their findings became important baseline information for 
numerous analyses of correlates of research productivity in 
the years to follow. 

At approximately the same time, another line of resea/ch 
emerged that provided a theoretical base for future perfor- 
mance studies. Robert Merton at Columbia University 
began work on the social structure ot institutions and the 
general orientations characterizing its participants (Storer 
1973). Merton studied the norms associated with scientific 
work in science, patterns of competition among scientists, 
the reward structure of science, scholarly refereeing, and 
inequality in scientific performance (Merton and Gaston 
1977). These studies added substance and depth to a field 
of study known today as the sociology of science. They 
also spawned numerous studies of scientific research per- 
formance by Merton' s students and colleagues: Zucker- 
man's (1977) study of Nobel laureates; Jonathan and Ste- 
phen Cole's (1973) examination of social stratifica f ion in 
sciences; Crane's (1965) analysis of productivity and schol- 
arly recognition; Crane's advisee at Yale, Gaston's (1978) 
study of reward systems; Hagstrom's (1965) work at 
Berkeley on scientific ommunities. From the early 1960s 
to the present, these authors and their studies have pro- 
vided a theoretical base for the study of research perfor- 
mance from the sociology-of-science literature. 

Purpose and Scope of Study 

This study reviews the literature on faculty research per- 
formance using four questions as an organizing framework: 
How is research performance, especially high research per- 
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formance, measured? What explanations exist for why 
some faculty become prolific research producers? What 
specific correlates (or factors) influence high icsearch per- 
formance? And what are the implications for faculty devel- 
opment, faculty evaluation, and future research? 

No common agreement exists among writers as to the 
proper term to use to describe varying levels of faculty 
research. Sociologists and management specialists use the 
terms "scientific performance 1 ' (e.g., Andrews 1979), "sci- 
entific productivity' * (e.g., Folger, Astin, and Bayer 1970), 
or "research performance" or "output" (e.g., Jauch and 
Glueck 1975). For consistency and simplicity, this discus- 
sion uses the terms "research productivity" and "research 
performance" interchangeably. 

Admittedly, these two terms are open to several inter- 
pretations. "Performance" or "productivity" can imply a 
high level or abundance (i.e., a large quantity^ of output 
(Hicks 1978-79). But, of course, the precise el varies by 
discipline, field, and institution. According t Jume and 
Sinclair (1973), whether an individual is proc active should 
be assessed by peers competent to judge. "Research" is 
equally vague. The term c. a be subsumed under the gen- 
eral concept "scholarly work," which Braxton and 
Toombs (1982) discussed as the application or use of 
knowledge and skills acquired through and certified by 
doctoral research training. Specific "research" activities 
may be broadly conceived as the 22 activities cited by the 
National Center for Higher Education Management Sys- 
tems (Manning and Romney 1973). Or it can be narrowly 
conceived to include submitting an article for publication in 
an academic or professional journal; publishing an article 
in an academic or professional journal; publishing or edit- 
ing, alone or in collaboration, a book or monograph; pub- 
lishing a book review; or delivering a paper at a profes- 
sional meeting (Pellino, Blackburn, and Boberg 1984). For 
purposes of this discussion, "research" assumes varied 
forms, and "productivity" and "performance" are defined 
as high or exemplary output, such output being determined 
within academic departments, colleges, and institutions. 

1 his review examines only individual faculty research 
performance. Analyses of departmental, collegial, or insti- 
tutional research performance are available elsewhere 
(e g., Kroc 1983; Wallhaus 1975). Also, this study is lim- 
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ited to "research" productivity, acknowledging that fac- 
ulty performance encompasses service and teaching as well 
as research (e.g., Kirschling 1979; Yuker 1978). On y stud- 
ies in the sciences and social sciences arc reviewed: few 
discussions are available in the literature for other disci- 
plines, such as the arts and humanities. Finally, this study 
draws heavily on the literature on the sociology oi science 
and data-based results from sociological studies. 
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MEASURES CF FACULTY RESEARCH PERFORMANCE 



A discussion of the oroblems relating to the measure- 
went of faculty productivity must start out with the rec- 
ognition of the fact that there are many problems 
involved in this type of measurement (Yuker 1978, 
p. 46). 



Although writers in the literature do not agree on which 
measures of individual research performance are most 
appropriate, they use three common measures: publication 
counts, citation counts, and peer and colleague ratings 
(Folger, Astin, and Bayer i970). Publication counts, which 
measure the quantity of individual output, may include 
papers presented at professional meetings, journal articles, 
monographs, chapters in books, and books written alone or 
in collaboration. Citations, which measure the quality of a 
publication and its "influence" on academic knowledge, 
are reflected in the number of times others cite it, as 
reported in published citation indices, such as the Science 
Citation Index (Cole, J. and Zuckerman 1984; Folger, 
Astin, and Bayer 1970). Ratings, by peers or colleagues, 
measure ** c eputation of a c cholar or researcher in the 
acadeir imunity (Cole, J. 1979). Ratings often include 
an assess .it of the perceived quality and visibility of 
research and the perceived contribution to general knowl- 
edge in the field (Cole, J. 1979; Pelz and Andrews 1966). 
Researchers gather ratings from questionnaires, letters, or 
interviews (Cole, J. 1979; Pelz and Andrew* 1966). 

The three measures are intercorrelated. Faculty prolific 
in publishing produce works that are heavily cited. This 
fact has been supported by studies establishing positive 
correlations in the rai^e of r= .50 to r= .75 between cita- 
tion and publication counts, depending on the sample 
(Cole, J. and Zuckerman 1984). Being cited is not only a 
by-product of copious publications: It also stems from 
major papers receiving much attention. Jonathan Cole and 
Zuckerman (1984) found that the more prolific the scien- 
tists were in publishing, the more citations their most cited 
paper received. 

Citations are also positively correlated with peer ratings 
Faculty peers use the works of those faculty who achieve 
prominence or are prominent in their field (Cole, J. 1979). 
Cole found that visibility with peers correlates positively 
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with publishing-productivity rates (ranging from r = .37 to 
r= .56) and with citation counts (ranging from r= .45 to 
r=.63). 

Research performance can be measured in ways other 
than publication counts, citation counts, and ratings. These 
include research grants obtained, appointment to editorial 
boards (i.e., eminence measures), and the development of 
patents, improved processes, new products, or new ana- 
lytic methods (see Centra 1977; Jauch and Glueck 1975; 
McPherson 1963; and Seldin 1984a). However, these mea- 
sures are little used in productivity studies. A random sam- 
ple of produciivity studies showed that the criterion mea- 
sures used are publication counts, citation counts, a combi- 
nation of publication and citation counts, and to a lesser 
extent, ratings (see Table 1). 

Publication Counts 

A popular measure for determining research performance 
is publication counts (Folger, Astir, and Bayer 1970). 
Caplow and McGee (1958) suggest that evaluation of per- 
formance is based almost exclusively on publications in 
scholarly books or journals. When they asked 371 inter- 
viewees the question, "Do you think he has reached the 
peak of his productivity as yet?", 122 of the respondents 
defined productivity as research or publication of research, 
14 referred either directly o: indirectly to teaching, and the 
other 235 were not specific j bout their definition. Caplow 
and McGee concluded, then, that "the explicit definition of 
publication as the criterion of productivity is very com- 
mon" (p. 70). 

Two common ways to measure publication or biblio- 
graphic counts are "straight counts" (Lindsey 1980) and 
weighted counts. "Straight counts" report the number of 
published journal articles, books, and monographs. 
Researchers can identify the number of journal articles 
written by a particular person through an author search of 
the ERIC system (Kroc 1983). They can also ask faculty to 
report their publications on a questionnaire. Wanner, 
Lewis, and Gregorio (1981) used this latter approach based 
on the 1972-73 national survey conducted by the American 
Council on Education (ACE). Though the authors admitted 
that self-reported measures are crude and that the 
researchers built no safeguards into the ACE survey to 
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TABLE 1 

RESEARCH PERFORMANCE MEASURES 
Data Collection 



Crane (1965) 
Clemente(1973) 
Astin(1978) 
Blackburn, 
Behymer, & 
Hall (1978) 
Cole, S. (1979) 
Knorretal ( 1 979) 
Cameron & 
Blackburn (1981) 
Wanner, Lewis, 
& Gregorio 
(1981) 

Creswell, Barnes, 
& Wende!(1982) 

Folger, Astin, 
& Bayer (1970) 

Cole, J &Cole, S 
(1973) 
Allison & 
Stewart (1974) 
HargensU978) 
Long (1978) 

Reskin(1978) 
Pelz& 

Andrews (1966) 
Cole. J (1979) 



Publication Counts 
index based on interview data 

Glenn & Villemez (1970) Comprehensive Index (GVCI) 
self-reported publications in ACE's 1972-73 national survey 
self-reported publications in ACE/Carnegie Commission's 1969 
national survey (Bayer 1970) 

.ounts in Science Citation Index 
self-reported number of papers published 
weighted scale frv publications drawn from vitae 

self-reported articles and books in ACE's 1972-73 national survey 



self-reported publications in Ladd & Lipset's (1978) national survey, 
1977 

Citation Counts 

Science Citation Index 

Publication and Citation Counts 

number of papers in Science Abstract, citations in Science Citation 
Index 

self-reported information; Chemical Abstracts, Science Citation Index 

Sc tenc e Citation Index and review of /ournals 

publications in Chemical Abstracts Citations in Science Citation 

Index 

self-reported publication counts; Science Citation Index counts 
Ratii.gs 

ratings by senior researchers in laboratory 
peei assessments made through questionnanes 
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check for the accuracy of self-repoi ted information, they 
hastened to add that questionnaire research is common- 
place in sociological studies. 

Gathering self-reported data may cost less than ether 
research techniques. Also, researchers can estimate the 
reliability of self-reported information. For example, Alli- 
son and Stewart (1974) estimated the reliability of 
responses from chemists in their sample by comparing self- 
reported information with publication counts from Chemi- 
cal Abstracts. The correlation was r = .94, which suggests 
that the data were reliable. 

Clemente (1972) reviewed studies incorporating weighted 
publication counts. In this procedure articles and books are 
given an arbitrary number of points. For example, Light- 
field (1971) assigned 1 point for an article, 1 point for an 
edited book, and 1 point per 100 pages of an original book; 
Manis (1951) awarded 1 point for articles and edited books, 
18 points for single-author books, and partial credit for 
coauthored books. After reviewing 10 studies that used dif- 
ferent weighting schemes, Clemente (1972) suggested the 
adoption of a standard index for measuring sociological 
productivity. He recommended the Glenn and Villemez 
f 1970) weighting scheme because it contained a quality rat- 
ing of journals derived through consensus by sociologists. 
The Glenn and Villemez index assigned 30 points to 
research and theoretical monographs, 15 points tc text- 
books (including revisions), 10 points to edited books, and 
from 4 to 10 points for articles in journals, depending on 
the quality of the journal (e.g., 10 points for articles in the 
American Sociological Review and the American Journal 
of Sociology). The Glenn and Villemez index implies that a 
weighting scheme should be based on values assigned only 
within specific academic fields or disciplines. A reasonable 
and acceptable weighting scheme across fields could be 
unreliable because faculty in disparate disciplines empha- 
size different forms of publication (e.g., journal articles in 
chemistry and books in political science) (Biglan 1973). 

The accuracy of both weighted counts and straight 
counts is limited in other ways. When researchers count 
publications they may give equal credit to poorly con- 
ceived papers appearing in badly edited journals and to 
well-written papers in ugh-quality journals (Smith and 
Fiedler 1971). In addition, they may compare counts from 
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disciplines with many publication outlets with those from 
disciplines with few outlets. They may count the contribu- 
tions of coauthors the same as contributions of single 
authors and consider the value of a shorter paper to be the 
same as that of a longer paper. And they may give more 
weight to the "operator" who produces quantity than the 
scholar who produces quality (Bayer and Folger 1966; 
Smith and Fiedler 1971). 

Citation Counts 

An emphasis on the quality of a publication has stimulated 
the use of citation counts as a measure of research perfor- 
mance. This approach assumes that a cited study has signif- 
icantly influenced the body of scientific knowledge (Folger, 
Astin, and Bayer 1970). Citation counts correlate highly 
with other measures of quality, such as employment in a 
prestigious university, listing in important bibliographies of 
scientists, and receiving scientific awards and recogiiitio . 
by colleagues, for example, the National Medal of Science, 
the Thorndike Award in psychology, and a Nobel prize 
(Kroc 1983; Lindsey 1980). 

Citation counts are a "natural weaning" ot written and 
accessible scholarly works, and they may be the single best 
measure of scientific achievement (Folger, Astin, and 
Bayer 197u, p. 257). Researchers base citation counts on 
information provided by citation indices developed in the 
past 20 years. Three popular indices are the Science Cita- 
tion Index (SCI), the Social Science Citation Index (SSCI), 
and the Arts and Humanities Citation Index (Garfield 
1979). The Journal Citation Report, published every third 
year, supplements the SCI and SSCI by providing data on 
journals covered by the indices (Kroc 1984 . 

All scientific papers include citations for elaboration, 
establishment of precedent, or for illustration. From the 
indices (e.g., SCI), which contain an author reference, a 
researcher can determine how many times an author's 
works are cited. If an author's work is valuable, others will 
refer to it. For example, in an early pilot study of the use 
of citation measures, Bayer and Folger (1966) analyzed the 
research performance of 467 biochemists using citation 
counts in the 1964 Science Caution Index, which reported 
on 27 source journals in biochemistry. From the SCI the}' 
identified the number of times each biochemist's publica- 
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tions were cited. Abstracts, book reviews, theses, correc- 
tions, editorials, and such items as letters and personal cor- 
respondence, as well as self-citations, were excluded from 
the counts. The lesult was a count of the number of cita- 
tions the authors of the studies in the 1964 journals made to 
the published scholarly works of the biochemists. 

Collecting citation counts is easy because of the avail- 
ability of citation indices. Citations also minimize the 
effects of an author's personality or employing ^titution 
on performance are less subject to personal manipulation 
than other m . _es of research performance, <\nd remain 
stable over time (Bayer and Folger 1966; Kroc 1983; Lind- 
sey 1980; Smith and Fiedler 1971). 

Most authors acknowledge the shortcomings of citation 
analysis (Kroc 1984; Lindsey 1978). Citations are suscepti- 
ble to fads and popular trends because researchers cite cer- 
tain works frequently. Citations may also be biased toward 
statistical and methodological studies routinely cited 
regardless of impact on the substance of an article. Lind- 
sey (1980) pointed out that when social scientists use a 
popular statistic, they feel compelled to cite the elementary 
statistical text from which they learned it. Citation indices 
ci f e works by first author, which makes it difficult for 
researchers to determine collaborative authorship. In Audi- 
tion, citations may not reflect current works of quality 
because of the lag between publication and citation. Jona- 
than Cole and Zuckerman (1984, p. 240) raise additional 
concerns about the accuracy of citation counts: 

Does a work cited an average of 55 times over 12 years 
have a greater impact than a work cited an average of 
32 times over 12 years? Or, have two scientists who have 
each been cited 50 times in a given year had the same 
impact when one has published 25 papers, each of which 
has been cited twice, and the other has also published 25 
papers but has two papers which received 25 citations 
each, while the other 23 received none at all? 

Not only is there confusion in interpreting the impact of a 
single paper or set of papers, but also in determining 
whether citations provide incentives to continue publishing 
and whether citations are an accurate measure of the 
''influence" of a work. Just how much publication is nec- 
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essary before a scientific contnoution becomes visible? 
And at what point do scientists' publications ' 'clutter 1 ' the 
literature? 

Ratings of Performance 

A inal measure of research performance is rating by peers 
within and outside the institution; by departmental chairs, 
deans, personnel committees; or by one's self (Centra 
1977; Seldin 1984a). Ratings reflect an individual's "reputa- 
tion," and a researcher's reputation affects his or her 
impact in shaping the cognitive content of a field, whether 
this impact is as a gatekeeper of ideas or as a developer of 
a research area or specialty (Cole, J. 1979). It also deter- 
mines rewards, such as employment opportunities from 
e'. er universities or large research grants from funding 
agencies. 

Jonathan Cole's study (1979) illustrated the use of peer 
ratings as a criterion measure of research performance. He 
examined the research reputations of faculty in sociology, 
psychology, and four biological-science specialities in 
American universities that grant doctorates. The study 
employed two dependent measures of reputational standing 
as evaluated by peers working in the same discipline: the 
perceived quality and the visibility of scientific research. 
Cole asked respondents to evaluate the importance of the 
work produced by a stratified random sample of scientists 
in their own field by using a six-point scale ranging from 
"ha« made very important contributions" to "have never 
heard ot this scientist." He measured individual visibility 
by the percentage of all respondents who thought they had 
enough information to rate the person. 

Measurement of research performance by ratios has 
many advantages. Ratings are a traditional met. ju for 
evaluating faculty research performance in deciding pro- 
motion and tenure. Ratings can reflect an inuividuaFs mar- 
ket worth, when peers off campus esteem an individual's 
research. Rating* are also highly related to other measures 
of performance, such as citation co nts and positions held 
in professional associations (Clark v57). And ratings may 
be a good measure of performan ^cause peers know the 
researcher's \vork and consider themselves qualified to 
compare it with the work of others (Pelz and Andrews 
1966). 
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On the other hand, because ratings are based on percep- 
tions, they may be flawed by inadequate or false informa- 
tion. They may reflect the quiJity of the institution in 
which the researcher is employed (the "halo effect"). 
Moreover, ratings are inherently "intersubjective," that is, 
peers and colleagues will apply different subjective criteria 
to reach the conclusion that an individual "has made very 
important contributions" (Cole, J. 1979; Folger, Astin, and 
Bayer 1970; Pelz and Andrews .966). These weaknesses 
influence the popularity of ratings as a way of measuring 
research performance, and few studies in the literature 
actually employ the measure ab a criterion. 

Summary 

Of the various measures of research performance in *he 
literature, the most common have been publication counts, 
citation counts, and ratings by peers and colleagues. 
Researchers count the number of publications of a scholar 
(e.g., journal articles, books, monographs) through 
"straight counts," obtained from self-reported information 
or by reviewing an educational data base such as ERIC, or 
through a weighting procedure that assigns arbitrary 
weights to types of publications. Researchers gather cita- 
tion counts using citation indices developed in the past 20 
years, such as the Science Citation Index or the Social Sci- 
ence Citation Index. Using these indices, researchers can 
obtain information about the total number of times individ- 
uals or their works are cited by others. Research perfoi- 
mance can also be measured by peer or colleague ratings. 
Peers or colleagues can evaluate the reputation of an indi- 
vidual's research by responding to a questionnaire, inter- 
view, or letter. 

Researchers do not agree on a common measure of 
research performance. Rather, research performance 
seems to be a multidimensional concept (Yuker 1978), fre- 
quently measured by publication and citation counts, and 
to a lesser extent, by peer or colleague ratings. 
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CONCEPTUAL EXPLANATIONS OF RESEARCH PERFORMANCE 



The number of publications scientists produce varies 
enormously, whether one looks at a year's production, 
or a five-year period, or a lifetime. And most of this vari- 
ation has never been explained in any published paper 
on the subject. That situation makes scientific productiv- 
ity one of the most difficult and perplexing problems in 
the sociology of science (Gaston 1978, p. 133). 



The average rate of faculty publication tends to be low and 
the variation in performance levels very high (Fox 1983). 
In 1926, Lotka advanced a mathematical distribution of 
performance rates in his inverse-square rule of scientific 
productivity. According to Lotka's rule, the number of 
people producing n scientific papers is proportional to 1/n 2 , 
that is, for every 100 authors who produce a single paper in 
a specific period, there are 25 who produce two, 1 1 with 
three, and so on (Price 1963). This means that 6 percent of 
the scientific community produces 50 percent of the scien- 
tific publications, or the average scientist publishes only 
about three papers in a lifetime (MacRoberts and Mac- 
Roberts 1982; Price 1963) 

Recent statistics from national surveys of the professo- 
riate confirm that many faculty publish few papers. As 
shown in Table 2,31 percent of the respondents (N = 
5 f &00) to Ladd and Lipsef s (1978) Survey of the American 
Professoriate published from zero to four journal articles 
during their careers; in 1969, 59 percent of the respondents 
to the American Council on Education-Carnegie Commis- 
sion survey (N = 60,000) reported publishing from zero to 
four journal articles. In contrast, prolific publishers, such 
as Nobel laureates, according to Zuckerman's 1977 study, 
publish an average of 13,1 papers before they reach the 
young age of 30. A matched sample of less distinguished 
scientists from American Men of Science produced an 
average of only 3.1 papers. Theodore Cockerell, a noted 
entomologist, publ'shed a stunning record of 3,904 papers 
during his career. He produced about two papers a week at 
his peak (Zuckerman 1970). 

Why do some faculty succeed in publishing widely 
acclaimed works year after year, while other scientists 
publish aimost nothing (Long 1978)? Four explanations are 
commonly discussed in the literature: psychological- 
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TABLE 2 

JOURNAL ARTICLES PUBLISHED IN UNIVERSITIES AS REPORTED 3Y 

NATIONAL SURVEYS 

American Council on 

Education & Carnegie American Council on 

Total Journal Comm., 1969 Education, 1972-73 Ladd & Lipset, 1977 

Articles Published (Bayer 1970) (Bayer 1973) (Ladd & Lipset 1978) 

None ?9.5% 24.0% 9.4% 

I- 4 29.7 25.9 21.9 
5-10 14 1 16.1 19.9 

II- 20 10.3 14.0 18.6 
21 + 16.3 19.9 30.3 



individual, cumulative advantage, reinforcement, and disci- 
plinary norms. Unfortunately, nc single study reviews all 
four explanations, though fox (1983) perceptively analyzed 
individual, environmental, and feedback (i.e., cumulative 
advantage and reinforc\aent) explanations. And Gaston 
(1978) and Allison and Stewart (19 7 4) discussed the cumu- 
lative advantage, psychological, and reinforcement expla 
nations. 



Psychological-Individual Explanations 

The psychological-individual explanation suggests tha* pro- 
ductive researchers possess certain psychological ami indi- 
vidual characteristics that are absent in less productive 
researchers. Sociologists who have ventured into the 
domain of psychology have explored this idea (see Fox 
1983), as well as psychologists who have studied "creativ- 
ity" (see Taylor and Barron 1963). 

A first variant of the psychological-individual explana- 
tion is that productive researchers may possess "innate" 
scientific ability or talent. Success or failure, tnen, is 
largely determined by the quality of native intelligence 
(Cole, J., and Cole, S. 1973), measurable by standard I.Q. 
tests (Cox 1980). I.Q. tests, however, as well as other stan- 
dardized measures of intelligence may be enly a rough indi- 
cator of ability, and it is doubtful whether intelligence is as 
unequally distributed amcng the population of faculty in 
higher education as is research performance (Fox 1983). 
Besides, evidence suggests that an insignificant negative 
correlation exists between I.Q. and scentific achievement 
(Bayer and Folger 1966). 
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A second variant is the "sacred spark" explanation, 
which maintains that faculty engage in research because 
they have a strong inner compulsion or motivation. 
According to Jonathan and Stephen Cole (1973, p. 62): 

Some scientists, no doubt, would continue to work 'tard 
on their research even if the norms prescribed that the 
researcher must remain anonymous. These scientists 
have the "sacred spark." They are motivated by an 
inner drive to do science and by a sheer love of the work. 

Eminent scientists are highly motivated, intellectually self- 
reliant, and confident in their ideas (Merton 1973; Pelz and 
Andrews 1966). A "spark" may be a function of the social- 
ization process of science, because the process tends to 
produce people who arc strongly committed to science. 
For them, 

research as an activity comes to be "natural" . . . they 
find it self-evident that pet sons should be excited by dis- 
coveries, intensely interested in the detailed working of 
nature, and committed to the elaboration of theories 
that are of no use whatever in daily life (Hagstrom 1965, 
p. 9) 

A third variant includes explanations based on the per- 
sonality traits of researchers. Biographical studies of emi- 
nent scientists reveal hardworking people who possess cer- 
tain cognitive structures (i.e., play with ideas, recombine 
familiar concepts, and tolerate ambiguity and abstraction) 
and have identifiable emotional characteristics (e.g., high 
ego strength, personal dominance) (Fox 1983; Roe 1953). 
Since certain stresses may relate to personality, research- 
ers are exploring the relationship between faculty stress 
levels (e.g., life events, family problems, attitudes toward 
job) and number of scholarly publications (Horowitz, 
Blackburn, and Edington 1984). 

A fourth variant explains research performance by back- 
ground or personal characteristics. Sociologists have 
explored gender differences and productivity (e.g., see 
Cole, J. 1979). There is conclusive evidence that men pub- 
lish more than women, but the literature is not ?s clear 
about the reasons for the differential output (and citations) 
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(Cole, J. and Zuckerman 1984). One possibility is that 
women may publish less than men because they are iso- 
lated from the "old boy" network and not in touch with 
the "invisible college" through which scientific informa- 
tion is exchanged. Moreover, women's work is not taken 
seriously by the academic community; their work often 
focuses on topics deemed insignificant by those in posi- 
tions of power (though Jonathan Cole and Zuckerman 1984 
contend that men may "clutter" the literature more than 
women) (Astin 1984). Women scientists seem more readily 
discouraged and less readily encouraged by varying 
degrees of citation to their work (Cole, j. and Zuckernun 
1984). And traditional family obligations of women prevent 
them from spending as much time working on research as 
men, though Stephen Cole (1979) has found that the stabil- 
ity and routinism associated with marriage are actually 
positively correlated with high publication rates. 

Another background characteristic used to explain high 
research performance is age. The literature on age and pro- 
ductivity is largely atheoretical (Reskin 1980). The relevant 
literature supports conflicting assumptions: growing old 
impairs performance, though performance improves with 
experience (and with age). One might argue that age 
impairs human performance because of psychological or 
mental decline or personality changes that interfere with 
performance. On the other hand, a< faculty age, the. gain 
valuable experience that shudld lead to improved pei r- 
mance. The negative and the positive impacts of agin fe 
could indeed cancel each other out or operate separately at 
different stages of a professional career (Reskin 1980). 
Reskin (1980) suggested several factors that affect the rela- 
tionship between aging and research performance: motiva- 
tion, risk-taking, stamina, socialization to research norms, 
the organizational reward system (including the monetary 
rewards for research), social position, competing demands 
on a scientist's time, extraprofessional roles (e.g., commit- 
ment to family), and the effect of scientific specialties. 



Cumulative Advantage 

Another explanation for research productivity, drawn from 
sociology more than psychology, is "cumulative advan- 
tage. 1 1 When the performance of faculty measures up to or 
exceeds institutional standards, a process of "cumulative 
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advantage" is initiated whereby "the individual acquires 
successively enlarged opportunities to advance his work 
(and the rewards that go with it) even further" (Merton and 
Gaston 1977, p. 89). The idea is based on Merton's (1973) 
"Matthew effect" in science: once scientists receive recog- 
nition (or resources) from their colleagues, they accrue 
additional advantages as they progress through their 
careers. This effect derived its name from a passage in the 
Gospel of Matthew, "For unto every one that hath shall be 
given, and he shall have abundance: but from him that hath 
not shall be taken away even that which he hath" (Merton 
1973, p. 445). 

The advantages typically begin with doctoral training in 
a prestigious department. The training, in turn, leads to a 
position in a major research university amply supplied with 
adequate resources for research (Long and McGinnis 
1981). Jonathan and Stephen Cole (1973) described the 
overall impact of the advantages: 

By virtue of being in top graduate departments and 
interacting with influential and brilliant scientists, some 
scientists have a social advantage in the process of 
stratification. Once position has been established in this 
initial phcse, the probabilities may no longer be the 
same for two scientists of equal abilities. The one who is 
strategically located in the stratification system may 
have a series of accumulating advantages over the one 
who is not a member of the elite corps (pp. 74-75). 

Studies of graduate-training experiences, employment in 
prestigious institutions, and resources available for 
research have tested this explanation (e.g., Allison and 
Stewart 1974; Cole, J. and Cole, S. 1973; Merton 1973). It 
is a common explanation in the literature on the sociology 
of science and is found juxtaposed with the psychological 
"sacred spark" explanation in several studies (Allison and 
Stewart 1974; Cole, J. and Cole, S. !973). 

Reinforcement 

Cumulative advantage is often confused with reinforce- 
ment as an explanation of productivity (Fox 1983). Both 
are derivatives of the "Matthew effect" and are related to 
recognition. But the two explanations are conceptually dis- 
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tinct: cumulative advantage deals with resources, presti- 
gious doctoral departments, and so forth; reinforcement 
addresses the feedback one receives from successful publi- 
cation of works, works being cited, aiJ formal and infor- 
mal praise from colleagues. The reinforcement explanation 
holds that when faculty publish, the recognition they 
receive for the contribution stimulates further publication 
(Gaston 1978). Thus, recognition motivates authors to pub- 
lish because it affirms an individual's personal worth. 
Although recognition may assume many forms, a common 
form is citations to published works. The Skinnerian 
behaviorist principle is that an activity that is rewarded 
continues to be performed, while an activity not rewarded 
tends to be dropped. Jonathan and Stephen Cole (1973) 
described the application of the idea to physics: 

Soon after they receive their degrees (and sometimes 
before), these young physicists begin to publish their 
research, whether alone or as part of a research 
team. . . . standards are high, and the manuscripts even 
of eminent scientists are sometimes rejected. Even 
though standards employed by the journals are high, a 
majority of papers are accepted for publication. More 
important than the formal evaluation of journals is the 
informal evaluation after publication by the international 
community of physicists. Sotretimes the published pap^r 
is largely ignored, with few citations to it, or it may be 
identified as a significant contribution and put to use in 
many other published researches. If the reward system, 
in the form of recognition by citation, does affect 
research productivity, we assume that the greater such 
collegial recognition of these early researches by physi- 
cists, the greater the probability that the physicists will 
continue to be productive. We hypothesize that few sci- 
entists will continue to engage in research if they are not 
rewarded for it (pp. 1 1 1-1 12). 

Several writers using different measures of recognition 
have confirmed the importance of reinforcement. Using 
citations, Jonathan and Stephen Cole (1973) determined 
that the more citations to early works, the more likely phy- 
sicists are to continue being productive. Using early publi- 
cations (i.e , publications accepted soon after receipt of the 
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doctorate), Meltzer (1949-50), Manis (1951), and Lightfield 
(1971) reported that early producers continue to maintain 
high levels of productivity throughout their careers. With 
great confidence Lightfield (1971) claimed, "Unless a per- 
son achieves a qualitative piece of research during his first 
five years as a sociologist ... it seems unlikely that he will 
qo so during his next five years— if at any time during his 
career" (p. 133). Using rate of publication as a surrogate 
measure of reinforcement, Blackburn, Behymer, and Hall 
(1978) found prior publications positively correlated with 
career publications, thus confirming a "habit of writing" 
th«( develops early in an individual's career and carries 
through to later life. This "habit" may be a result of a rein- 
forcement process whereby the reward system encourages 
research activities (Cole, S. and Cole, J. 1967; Fox 1983; 
Lightfield 1971). 

Another aspect of reinforcement is the informal recogni- 
tion given to a scholar by colleagues. Gaston (1978) and 
Reskin (1977) attributed productivity to the immediate 
reinforcement that researchers received from colleagues 
rather than to the delayed reinforcement of having their 
works cited. Such reinforcement may include promotion in 
rank or the conferring of tenure. Reskin (19 7 7) discussed 
collegial recognition: 



Of all the 

explanations 

for research 

performance, 

reinforcement 

may be the 

most 

important . . . 



In such contexts (research-oriented institutions), imme- 
diate informal recognition from research-oriented col- 
leagues may be more important in maintaining produc- 
tivity than the formal, but delayed recognition that cita- 
tions provide. . . . Given the reward structure of most 
university departments, the act of publishing— signalling 
both successful professional performance and a variety 
of forthcoming rewards— may be especially reinforcing 
to university scientists (p. 502). 

Of all the explanations for research performance, rein- 
forcement may be the most important because of the 
strong positive relationship between its measures (e.g., 
prior productivity) and high performance levels. 



Disciplinary Norms 

Colleagues and the disciplinary environment shape 
research performance. As one historian of science 
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TABLE 3 

SELECTED STUDIES OF FACULTY RESEARCH PRODUCTIVITY, SINGLE 
AND MULTIPLE DISCIPLINES AND NATIONAL DATA BASES 



Selected 
Studies 



Single 
Discipline 



Multiple 
Disciplines 



National 
Data Base 



Allison & Stewart (1974) 



Astin (1978) 

Babchuk & Bates (1962) sociologists 
Bayer & Folger (1966) biochemists 
Blackburn, Behymer, & Hall 
(1978) 

Braxton (1983) 

Cameron & Blackburn (1981) 



Clemente (1973) sociologists 
Cole, J. & Cole, S.{ 1973) 



Ccle, S (1979) 
Crane (1965) 



Creswell, Barnes, & Wendel 
(19P 

Creswell, Patterson, & Barnes 

(1984a, b) 
Fulton & Trow (1974) 



Hargens(1978) 



Hargens, McCann, & Rc^km chemists 
(1978) 



biologists, 
mathematicians, 
chemists, 
physicists 



chemists, 

psychologists 

Unghsh, 

psychologists, 

sociologists 

physical, 
biological, and 
social scientists 

biologists, 
political 
scientists, 
psychologists 



chemists, 
mathematicians, 
pohticial 
scientists 



ACE 1972-73 survey 



ACE/Carnegie 
Commission 1969 
sui vey 



ACE 1972-73 survey 



Ladd & Lipset 1977 
survey 

Ladd & Lipset 1977 
survey 
Carnegie 
Commission 1969 
survey 
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TABLE 3 (continued) 



Selected 
Studies 

Knorr etal. (1979) 

Lightfield(1971) 
Long &McGinnis (1981) 
Long (1978) 
Mams (1951) 

Mekzer (1949-50) 

Pelz& Andrews (1966) 



Reskin (1979) 

Wanner, Lewis, & Gregono 
(1981) 



Single 
Discipline 



sociologists 
bicchemists 
biochemists 



chemists 



Multiple 
Disciplines 



social 

scientists 

social 

scientists 

biological, 

physical, social 

scientists 



Nation*! 
Data Base 

UNESCO Int'l 
comparative study 



hCE 1972-73 survey 



remarked, "The study of science, after all, begins with its 
product, scientific knowledge, rather than simply with 
those individuals who occupy the social position of 'scien- 
tist' " (Storer 1973, p. xvii). Thus, the norms of a disci- 
pline (or field of study), as well as scientific knowledge in 
the discipline, partially explain variations in faculty 
research performance. During the past 40 years studies 
have sampled faculty from single disciplines and multiple 
disciplines, and most major disciplines have been sampled 
in national surveys. (See Table 3.) In national surveys, 
researchers can compare faculty across disciplines and iso- 
late the effects of discipline membership on performance 
(e.g., Blackburn, Behymer, and Hall 1978; Wanner, Lewis, 
and Gregorio 1981). 

The norms of a discipline affect faculty research perfor- 
mance in two ways: by the degree of codification of knowl- 
edge (or stage of paradigm development) (Zuckennan and 
Merton 1973) and by differences in the research activities, 
called the social activities of disciplines by Gaston (1978). 
The codification of knowledge is best understood by 
reviewing Thomas Kuhn's (1970) classic treatment of para- 
digm structure in [he Structure of Scientific Revolutions. 
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He described how fields in science are not uniformly devel- 
oped. Fields differ in their stage of paradigmatic develop- 
ment: in the understanding of the accepted theory; in the 
preferred methodologies; and in the understanding of the 
important areas to study. According to Lodahl and Gordon 
(1972), the paradigm "provides structure by suggesting 
which problems require investigation next, what methods 
are appropriate to their study, and even which findings are 
indeed 'proven' M (p. 58). Disciplines are in different para- 
digmatic stages. Social sciences (e.g., political science) are 
immature fields and are considered to be in a pre- 
paradigmatic stage. The physical sciences (e.g., physics) 
are mature fields and in a paradigmatic stage. 

The paradigmatic stage of a discipline affects scholarly 
research (Lodahl and Gordon 1972). It affects acceptance 
rates in journals: in fields in which the acceptance rates aie 
high (e.g., physics), the degree of codification is high 
because individuals in the field agree on the important 
questions and approriate methods to address them (Gaston 
1978; see also Whitely's 1977 discussion of "restricted" 
and "unrestricted" sciences). It also affects the form of 
communication: an abbreviated form of scholarly commu- 
nication, journal articles, is permitted in disciplines in a 
paradigmatic stage, such as the physical sciences, and a 
lengthened form, books and monographs, is required in 
pre-paradigmatic fields, such as education (Biglan 1973). 

Disciplines also differ in their research activities. Gaston 
(1978) outlined some of these differences: the amount of 
concern scientists express about being anticipated in their 
current research (the priority struggle); the age of the liter- 
ature referred to by scientific papers; the average number 
of papers produced annually, the validity of published 
answers to research questions; the extent to which mathe- 
matics is used in research; the coauthorship patterns; the 
reliance on research assistants to make all or most of the 
observations and measurements; and the division of labor 
on manuscripts for which various collaborators supply spe- 
cial skills. 

Certainly, other factors are also important. Though 
researchers know about differences in the cognitive struc- 
ture and research activities of disciplines, they have yet to 
explore the exact impact of those differences on productiv- 
ity. Few studies directly address this impact (an exception 
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being Biglan 1973), and most include academic discipline 
as control variable (e.g., Wanner, Lewis, and Gregorio 
1981) in the assessment of correlates associated with pro- 
ductivity. 

Summary 

The research performance of faculty in higher educati «. 
highly variable. Most of the scholarly research is being 
produced by a few faculty. Thus, productivity researchers 
attempt to explain the variation in faculty research perfor- 
mance by psychological-individual factors, including supe- 
rior intellectual ability (innate ability); a strng motivation 
and drive to perform (sacred spark); personality traits; and 
background characteristics, such as gender and age. 
Another explanation is the 4 'cumulative advantage" argu- 
ment, which is based on the idea that some faculty accrue 
resources and the advantages of position whereas other 
faculty do not. These resources and advantages, in turn, 
contribute to high levels of productivity. Finally, high per- 
formance levels result from the positive reinforcement 
some faculty receive for their works and from the norms 
and expectations of their disciplines. 
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CORRELATES OF RESEARCH PERFORMANCE 



Effective research is a product, first, of a sociotultural 
climate; second, of a sufficiency of individuals gifted 
with an uncommon combination of abilities and charac- 
ter qualities; third, of a satisfactory economic- 
administrative matrix; fourth, of special acquired 
research skills and thought processes; and last, of daily 
working conditions which, at the least, must not hamper 
creative minds (Cattell, 1963, p. 199). 

Writers have examined the explanations of faculty research 
performance using a complex set of correlates (or factors). 
Numerous studies report correlates of research perfor- 
mance in sociology, psychology, and, to a lesser extent, 
education in the past 40 years. These studies examine a 
common core of correlates, and they can be related gener- 
ally to the explanations discussed earlier, as shown in Table 4 
(see p. 28). The relationship is not perfect, however, because 
some correlates can be used to test several explanations 
(e.g., academic rank leads to cumulative advantage as well 
as recognition and reinforcement from peers). Most of the 
correlate studies are multivariate in design, and the authors 
examine the relative influence of each correlate indepen- 
dently v e.g., see Blackburn, Behymer, and Hall 1978; Cle- 
m^te 1973; Fox 1983; Wanner, Lewis, and Gregorio 
198 1). A few of the correlate studies use a bivariate design 
to examine the relationship between one correlate and 
research performance (e.g., Holley 1977). Complex causal 
models are reported in Reskin's (1979) test of the effect of 
academic sponsorship on scientists' decade productivity 
(i.e., 10 years after doctorate), Knorr et al.'s (1979) exami- 
nation of a social-position mcdel, and Bean's (1982) macro- 
orgar.;z? f ional model. A wide array of correlates arc 
reviewed by Clemente (1973) and Finkelstein (1984). In an 
excellent synthesis, Fox (1983) organizes the correlates in 
term: jf individual-level characteristics (psychological 
chaiactenstics, work habits, demographic characteristics), 
environmental location, and feedback processes. Some 
writers also indicate methodological problems associated 
with the use of correlates (Bayer and Dutton 1977; Reskin 
1980). 

This discussion reviews the major correlates reported in 
research-productivity studies, Specific measures are identi- 
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Variables 



TABLE 4 

CORRELATES OF FACULTY RESEARCH PRODUCTIVITY 
Selected Studies 



Intelligence scores 
Motivation 

Personality characteristics 
Stress 

Age 



Gender 



Psychological-Individual Explanation 

Bayer & Folger (1966); Folger, Astin, & Bayer (1970) 
Gaston (1978); Hunter & Kuh (1984); Pelz & Andrews 
(1966) 

Fox (1983); Roe (1953); Taylor & Ellison (1967) 
Gmelch, Wilke, & Lovrich (1984); Horowitz, Blackburn, 
& Edington (1984); McKeachie (1983) 
Bayer & Dutton (1977); Blackburn & Havighurst (1979); 
Cole, S. (1979); Creswell, Patterson, & Barnes (1984a); 
Lehman (1953); Over (1982); Pelz & Andrews (1966) 
Astin (1978); Babchuk & Bates (1966); Blackburn, 
Behymer, & Hall (1978); Cameron & Blackburn (1981); 
Folger, Astin, & Bayer (1970); Hargens, McCann, & 
Reskin(1978) 

Cumulative Advantage Explanation 



Prestige of doctoral program 
Mentoring 

Prestige of employing institution 
Resources and assignment 



Colleagues 

Academic rank and tenure 
Early productivity 

Preference for research 
Disciplinary differences 



Crane (1965); Reskin (1979) 

Cameron & Blackburn (1981); Long (1978); Reskin (1979) 
Crane (1965); Long & McGinnis (1981) 
Allison & Stewart (1974); Knorr et al. (1979); Pelz & 
Andrews (1966) 

Reinforcement Explanation 

Braxton (1983); Collins (1971); Finkelstein (1982); 
Parker, Lingwood, & Paisley (1968); Pelz & Andrews 
(1966) 

Blackburn, Behymer, & Hall (1978); Creswell, Patterson, 
& Barnes (1984a); Holley (1977): Neumann (1979) 
Blackburn, Behymer, & Hall (1978); Clemente (1973); 
Cole, S. & Cole, J. (1973); Lightfield (1971); Manis 
(1951); Meltzer (1949-50); Reskin (1979) 
Blackburn, Behymer, & Hall (1978); CreswelL Barnes, & 
Wendel (1982) 

Disciplinary Norms Explanation 

Bigian (1973); Creswell, Barnes. & Wendel (1982); 
Wanner, Lewis. & Gregono (1981) 
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fied, potential problems arising from their use are dis- 
cussed, and their overall power to predict high research 
performance is assessed. 



Intelligence Test Scores 

Intelligence, as measured by intelligence test scores, has 
little predictive influence on high research performance. 
Studies of doctoral-level biochemists in 1957 (Bayer and 
Folger 1966) and in 1964 (Folger, Astin, and Bayer 1970) 
reported low correlations between intelligence test scores 
and productivity, as measured by citation counts (correla- 
tions ranged from -.049 to +1.0). In another study, Jona- 
than and Stephen Cole (1973) confirmed the low correla- 
tions between test scores and publication counts (r = .05) 
for physical, biological, and social scientists. 

Low correlations may be attributable to inexact mea- 
sures of ability (Cole, J. and Cole, S. 1973) or to a possible 
interaction between intelligence and environmental influ- 
ences. Regarding the interaction effects, Jonathan and Ste- 
phen Cole (1973) established that I.Q. was significantly 
related to the prestige of a scientist's academic depart- 
ment. Whereas intelligent faculty are probably employed in 
prestigious departments, the impact of intelligence on pro- 
ductivity is attenuated by departmental influences. Job set- 
ting, over time, assumes greater and greater predictive 
power in regard to performance. 

Motivation 

The precise impact of indi v ; Jual motivation on research 
performance is unknown. Measures of motivation are 
imprecise (Gaston 1978). Since motives constantly change, 
measuring motivation after the fact is methodologically dif- 
ficult. Intensity of motivation among scholars also varies, 
and it is difficult to separate individual motives from envi- 
ronmental influences (Gaston 19 7 8). Despite these prob- 
lems, however, faculty are more intrinsically motivated 
than extnnsically motivated to produce research. Pelz ~nd 
Andrews (1966) found effective university research sci^- 
tists to be motivated to produce by strong inner sources, 
the desire for freedom to follow one's ideas, and the stimu- 
lation from one's previous work. Those scientists who 
were consistently low producers relied on supervisors or 
advisors for their motivation. In another study, Hunter and 
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Kuh (1984) described "prolific 1 1 scholars in higher educa- 
tion and student personnel administration as individuals 
who placed little importance on extrinsic sources of moti- 
vation, such as salary incentives, and great importance on 
the genuine enjoyment of engaging in scholarly activities. 

Personality Characteristics 

Scholars may bring to their careers certain personality 
characteristics that predispose them to be high producers. 
Biographical sketches of distinguished scholars have iden- 
tified these characteristics (Fox 1983). A well-known study 
is that of the Yale psychologist, Anne Roe (1953, 1972), 
who examined the life histories of 64 eminent male physi- 
cal and social scientists. Her life histories revealed that 
these eminent scientists had certain characteristics in com- 
mon: they were from families with fathers who were 
professionals; they existed on their own resources early in 
life (e.g., some lost a parent); they held intense private 
interests in their youth; and they became involved in 
"gadgeteering" early in life. In terms of their general per- 
sonality structure, the eminent scientists relied on rational 
controls, were uncritical people, and spent their time think- 
ing about things in a question-answer way. 

In another study, Collins (1971) found that creative sci- 
entists could be distinguished from less creative scientists 
by their personality profiles: creative scientists were more 
exact, r seise, reliable, intelligent, and introverted. Taylor 
and Ellison (1967) analyzed the personality characteristics 
of 2,000 scientists in the Office of the National Aeronautics 
and Space Administration. Biographical information 
showed productive scientists to be independent, not 
swayed by general consensus, intellectually oriented, and 
confident in their abilities. This last trait, confidence, is a 
distinguishing characteristic of "prolific" scholars in the 
field of higher education and student personnel administra- 
tion, as well. Hunter and Kuh (1984) found that "prolific" 
scholars display a "confidence personality factor," includ- 
ing an easygoing temperament, sense of humor, and confi- 
dence. 

Personality traits undoubtedly influence research perfor- 
mance, but they do not act in a vacuum. Social factors 
affect the translation of personality (or creativity) into 
innovative performance (Fox 1983). Thus, strong interac- 
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tive effects exist ainong personality traits, social and orga- 
nizational variables, and high research performance. Fur- 
ther research studies are needed to increase our under- 
standing of the interactive effects. 

Stress 

The relationship of individual stress to research productiv- 
ity is a recent area of investigation, McKeachie (1983) 
reviewed stressful events on the job that can result in low- 
ered productivity . departmental chairs or administrators 
who are critical and unappreciative of good work, incom- 
patible colleagues, and lack of . aspect by others for what 
one is doing. When these facton affect an individual's job, 
4 4 displacement activities" set in, such as hobbies, involve- 
ment in community services, and consulting or moneymak- 
ing ventures. These activities are certainly not physically 
threatening. However, physiological reactions, such as 
high triglycerides, high cholesterol, and others, may result 
from stress and affect overall research performance 
(Horowitz, Blackburn, and Edington 1984). Also, failure to 
receive anticipated rewards and recognition ii- the work- 
place is a source of stress that may influence research pro- 
ductivity (Gmelch, Wilke, and Lovrich 1984). 

Age 

The precise relationship between age and research produc- 
tivity is difficult to determine because of complex measure- 
ment and other methodological problems. Various studies 
use different measures of age: chronological age (Cole, S. 
1979; Pelz and Andrews 1966); years o* professional expe- 
rience (Creswell, Patterson, and r ^84a); number of 
years since receipt of the doctora >n and Stewart 
1974; Bayer and Dutton 1977); and a combination of aca- 
demic rank and years of experience in higher education 
(Baldwin and Blackburn 1981). The use of different mea- 
sures makes generalizations of results from one study to 
another difficult. The studies also report cross-sectional 
rather than longitudinal data, thereby possibly entangling 
the effects of age with the effects of cohorts (Cole, S. 1979; 
Reskin 1980). Cohorts may differ in research performance 
not simply because of age differences but also because the 
pressures to publish vary from one historical period to 
another. Acknowledging this entangling effect, authors 
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have turned to other data collection procedures, such as 
longitudinal designs (in which a cohort group is followed 
over several decades) or a combination of cross-sectional 
and longitudinal designs, called a cross-sequential 
approach (Over 1982). But even these designs are subject 
to sample attrition problems. 

A further difficulty is identifying the true "age curve" 
between age and research productivity. One model holds 
that the "age curve" is curvilinear. Lehman (1953) found 
that scholarly achievement peaks in the late thirties and 
early forties and declines thereafter (Oliver Wendell 
Holmes, Jr., is said to have remarked, "If you haven't cut 
your name on the door of fame by the time you've reached 
40, you might just as well put up your jackknife" (quoted 
on p. 186). The decline in performance after one's early 
forties was also established by Stephen Cole (1979) and 
Over (1982). The decline in productivity in mid-career was 
attributed to reduced motivation to do research and devot- 
ing less time to research. 

Another model suggests that the relationship is bimodal 
or "saddle-shaped" (Pelz and Andrews 1966). Pelz and 
Andrews found that publication productivity peaks during 
the ages of 35 to 44 and 50 to 54. Bayer and Dutton (1977) 
aho confirmed this relationship; a "spurt-obsolescence 
curve" best fitted five of seven disciplines they studied. 
They attibuted the two-peak curve to changing market con- 
ditions and to the attrition of productive scientists away 
from academia during the second half of their careers and 
their return to faculty positions late in life. Pelz and 
Andrews (1966) ascribed the decline in middle years to a 
lack of "zeal or motivation" and a "fresh viewpoint" 
(p. 197). 

A third possibility for the "true" age curve is discusseu 
by Hammel (1980) and Creswell, Patterson, and Barnes 
(1984b). This curve is one of a gradually decelerating 
increase, thus confirming that productivity increases with 
age and that there is some evidence of a flattening, but not 
necessarily a decline. This curve may better fit high pro- 
ducers than low producers (Creswell, Patterson, and 
Barnes 1984b). 

Ttz best "age curve" is probably a function of the sam- 
ple being studied (see Bayer and Dutton :?77) and the cri- 
terion measures of age and productivity used (Reskin 
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1980). These qualifications aside, various monotonic 
functions (e.g., "obsolescence," "spurt," and "spurt- 
obsolescence") or a bimodal curve, represented by a peak 
in performance about 10 years after the doctorate and a 
second peak toward the end of a faculty career, best 
describe the relatiohship between age and research (Reskin 
1980). 

Age, by itself, has little predictive influence on perfor- 
mance: variables highly related to age more precisely 
explain productivity than does age itself. Bayer and Dutton 
(1977) could explain only 7 percent of the variance in 
research productivity with age; Over (1982) found age to be 
an insignificant correlate when productivity was regressed 
against sex, academic rank, prior publication rate, and 
research standing of the university. Blackburn, Behymer, 
and Hall (1978) eliminated age entirely in their final statisti- 
cal analysis because age correlated highly with academic 
rank. 

Age, however, exerciser an important mediating influ- 
ence as a correlate of research performance. Blackburn 
and Havighurst (1979) examined the productivity of 74 
U.S. male scientists born between 1893 and 1903. They 
divided scientists age 55 and older into four groups of pro- 
ducers and examined the correlates of productivity for 
each group. T hey concluded that an early start in publish- 
ing and the work environment of the scholar significantly 
influenced the 74 research careers. In another study, Cres- 
well, Patterson, and Barnes (1984a) divided a national sam- 
ple of faculty into four career-age groups similar to those 
used by Bayer and Dutton (1977). They then examined the 
significant correlates at each career age and found that 
some factors remained stable during the careers of faculty 
(e.g., time and preference for research, membership in 
select disciplines) but that others fluctuated (e fi , feelings 
about success, importance of rank attained). 

Gender 

Three questions are apparent in studies relating gender to 
research productivity: (1) whether one gender publishes 
more than the other; (2) whether the correlates of reseaic.i 
productivity differ dramatically for women and men; and 
(3) whether gender per se is an importa.it correlate of high 
research performance. 
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Men are generally more published and cited than 
women. In a study of 262 sociologists, Babchuk and Bates 
(1962) reported that women were far less prolific in publi- 
cation than men and were overrepresented in the low- 
publication categories. Only 2 of the 37 women in the sam- 
ple had published more than five articles. Astin (1969), in a 
study of faculty who responded to the American Council 
on Education's 1972-73 survey, found that 26 percent of 
the women and only 10 percent of the men were unpub- 
lished in journals. In a later study by Astin (1984), a com- 
parison of publication rates for women and men from 
national surveys conducted in 1969, 1972, and 1980 showed 
that the men outproduced the women in each time period, 
but that the growth in productivity among academic 
women was greater than that among men between 1969 and 
1980. In a study of 526 men and women scientists in 
astronomy, biochemistry, chemistry, earth sciences, math- 
ematics, and physics, Jonathan Cole and Zuckerman (1984) 
found men were more prolific than women, publishing 1 1.2 
papers compared with 6.4 during a 12-year perioa. Other 
authors also report gender differences in publications and 
citations (see, for example, Cole, J. 1979; Hargens, 
McCann, and Reskin 1978). 

The evidence suggests that the correlates of research 
performance for men and women are not the same, despite 
early studies that suggested common correlates for both 
men and women (Folger, Astin, and Bayer 1970). Women 
respond differently from men to the reinforcement they 
receive through citations (Cole, J. and Zuckerman 1984). 
Women may need more encouragement than men to main- 
tain the level of publication they set for themselves early in 
their careers. The caliber of the Ph.D. department is more 
important for men's research performance than for wom- 
en's. Also, women benefit more from employment in a ten- 
ure-track position and fr >m postdoctoral fellowships, and 
they are more influenced by citations than men (Reskin 
1978). 

Gender, however, is an insignificant correlate of produc- 
t^ity when compared with other correlates (Bernard 1964; 
Blackburn, Behymer, and Hall, 1978; Cameron and Black- 
burn 1981; Cole, J. and Zuckerman 1984). When gender 
appears important (such as in the study by Hargens, 
McCann, and Reskin 1978), the influence is only indirect 
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because it correlates highly with other variables. Black- 
burn, Behymer, and Hall (1978) state: ''Much of what we 
see on the surface as sex differences for productivity can 
be explained by examining the sex differences in variables 
which most strongly correlate with productivity" (p. 138). 

Prestifc? of Doctoral Program and Mentoring 

Graduate programs socialize students to the values and 
norms of the profession. Brim and Wheeler (1966, p. 83) 
described this as the "process of movement through the 
setting," whereby a training program socializes students to 
enter the faculty ranks; after students assume faculty posi- 
tions, informed controls and sanctions push them toward 
activities perceived as valuable (Bess 1978). 

This process has interested productivity writers, and 
studies have explored the ^lationship between the prestige 
of the doctoral department and research performance. The 
studies employ various prestige measures: Long (1978) 
used the Roose and Anderson (1970) scale; Reskin (1979), 
the Cartter (1966) scale; and Crane (1965), the Keniston 
(1959) scale. Studies show that completing a doctorate 
(used as the terminal degree of study rather than the mas- 
ter's degree) from a prestigious department has short-liveJ 
effect on research performance. The effect lasts only 
through the first six years, possibly through the first 
decade, dfter graduation (Long 1978; Reskin 1979). 
Wheiher ths doctoral department creates an "indelible 
mark' or. the student's career," as Caplow and McGee 
(1958, p. 193) suggested, is questionable. The impact of the 
department declines over time and is replaced by the influ- 
ence of the first academic job (Hargens and Hagstrom 
1967). 

Reskin (1979) attributed the Tluence of doctoral depart- 
ment on productivity during the first dec.de to the high- 
quality training, the resources available, and the eminence 
of faculty serving on student committees. In addition, she 
contended that the graduate selection process operates to 
attract talented students to quality programs. Crane (1965) 
discussed this process: 

Most of the best students are channeled into the best 
graduate schools and, in turn, the best of these are 
selected for training by the to;, scientists. This highly 
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select group becomes the next generation's most pro- 
ductive scientists, most frequently chosen for positions 
in major universities (p. 705). 

As Crane suggests, top scientists select talented students 
as mentees. Working with an eminent mentor affects the 
productivity of the student in the predoctoral phase of 
training (Reskin 1979) and in the early years after receipt of 
the doctorate (Long 1978). Close collaboration between 
student and mentor typically ceases after the degree is 
granted, but the impact of early publication continues to 
influence the student's rate of publication for at least three 
years (Long 1978). Mentors provide superior training and a 
professional orientation to graduate students, and bright 
students seek out productive mentors (Reskin 1979). Zuck- 
erman (1977) discussed common mentoring relationships 
thai developed between Nobel laureates and their students. 

Neither the prestige of the doctoral department nor grad- 
uate student affiliation with an eminent mentor, therefore, 
strongly affects the long-term productivity of scholars. 
While Cameron and Blackburn (1981) found that sponsor- 
ship variables (e.g., early collaboration with senior faculty) 
influence performance, the relative influence of sponsor- 
ship was minimal. The place of work strongly predicted 
high research performance. Long (1978) explained away 
much of the influence of a mentor because of the strong 
impact of .iree and six years of the work environment of 
an institution. 

Prestige of Employing Institution 
Major universities attract talented graduated students to 
their positions (Crane 1965). But employment in a presti- 
gious institution shapes and stimulates individual research 
performance. As Long (1978) pointed out, biochemists 
attain position because of factors related to graduate edu- 
cation, sponsorship, and postdoctoral study. Once a gradu- 
ate is employed in a prestigious institution, the correlation 
between the prestige of the institution and productivity 
grows larger over time. Then, when the faculty moves, the 
etfects of the prior department and institution dissipate, 
and the influence of the new department on the scholar 
increases markedly within five years. Results from Long 
and McGinnis's (1981) study of biochemists support this 
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finding. Within three to six years of obtaining a position in 
a specific context, the biochemist's level of productivity 
conformed to the characteristics of that context. Compared 
with citation counts for faculty in research universities, the 
number of citations to publications of biochemists involved 
in industrial research, teaching in four-year colleges, or 
administering a laboratory declined. For those scientists 
who moved to another institution, Long and McGinnis 
found that within six years after the move, productivity 
was largely determined by the context of the new position. 

Why prestigious departments or institutions enhance 
productivity is unclear (Fox 1983). Crane (1965) attributed 
it to the recruitment of talented graduates by major univer- 
sities or the visibility and contacts that accrue to faculty in 
major institutions. Long (1978) reasoned that superior 
departments may have the prescience to select those indi- 
viduals who will become productive. Papers submitted by 
faculty in prestigious departments may appear superior and 
be more readily accepted for publica f 'on. Prestigious 
departments and institutions tend io be larger and to pos- 
sess resources and colleagues that iacilitate research. 



Spending too 
much or too 
little work 
time on 
research 
actually may 
impede 
performance. 



Resources and Assignment 

Resources contribute to a productive research career, and 
high-quality institutions typically have access to money, 
time for faculty research, competent assistants, stimulating 
colleagues for faculty, and easy access to information (Alli- 
son and Stewart 1974). Allison and Stewart (1974) mea- 
sured resources as the percentage of work time spent on 
reseaich, the number of research assistants, and the pro- 
portion of respondents who reported that they "always" 
get the grants they seek (p. 603). From a sample of biolo- 
gists, mathematicians, physicists, and chemists, they found 
work time spent on research to be an important predictor 
of high research performance. During an academic career, 
the amount of work time spent on research continued to be 
substantial for productive scholars and declined for less 
productive ones. 

Spending too much or too little work time on research 
actually may impede performance. Pelz and Andrews 
(1966) established that the lowest levels of success in 
journal-article productivity were associated with spending 
either a very small or a very large proportion of time on 
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research. They found that a mixture of research and nonre- 
search, such as teaching and administration, facilitated 
research performance. Knorr et al. (1979) suggested that 
spending less than 10 percent or more than 80 percent of 
one's time on research was associated with low research 
achievement. Productivity peaked when about one-third of 
a scientist's time was spent on research. The remaining 
time might be spent on teaching and administration. 

Administrative duties may provide the necessary 
resources that actually enhance performance. Knorr et al. 
(1979) tested the proposition that scientific productivity 
was associated with the status or position a scientist held 
in the formal or informal hierarchy of the organization. 
They argued that higher position (i.e., administrative posi- 
tion) contributed to productive research because ' a scien- 
tist's publication capacity is multiplied by the task force he 
or she supervises and by the project (and other) money to 
which he or she gains access" (pp. 57-58). Knorr et al. 
examined this intriguing proposition using a data set of sci- 
entists located in academic and industrial organizations. 
They found that once a scientist attained a supervisory 
position, manpower resources and project tasks contrib- 
uted to high research performance. 

Colleagues 

Productive researchers are those individuals who maintain 
regular contacts with colleagues, especially research- 
oriented colleagues (Behymer 1974). Interpersonal con- 
tacts, such as visits and telephone conversations with col- 
leagues outside the institution, seem to affect research per- 
formance significantly. Pelz and Andrews (1966) found that 
high research performers contacted a large number of peo- 
ple, spent time making those contacts, and maintained 
semiweekly or daily contact with colleagues. Braxton 
(1983) examined the impact of departmental colleagues on 
individual research productivity by studying the work hab- 
its of chemistry and psychology professors in liberal arts 
colleges. A liberal arts professor who had seldom or never 
published in the past was likely to publish somewhat more 
if departmental colleagues were productive scholars than if 
the colleagues were low research performers. A high 
research producer, however, was little affected by the pub- 
lication activity of departmental colleagues. 
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Fink elstein (1982) explored the impact of colleagues off 
campus as well as on campus. He examined collegial inter- 
action with departmental colleagues, extradepartmental 
campus colleagues, and off-campus disciplinary colleagues 
for faculty in a nrivate university and two liberal arts col- 
leges. He discovered that productive faculty combined 
strong off-campus collegial functioning with strong depart- 
mental interactions and relative insulation from extrade- 
partmental campus colleagues. Thus, he called attention to 
the importance of both on- and off-campus colleagues in 
the life of productive scholars. 

Colleagues are an important source of information for 
productive scholars. Parker, Lingwood, and Paisley (1968) 
explored the relationship between communication behavior 
and research productivity for "communication research- 
ers" and individuals included in the National Science 
Foundation's 1966 National Register of Scientific and 
Technical Personnel. The authors defined communication 
behavior as "interpersonal contact," including receipt of 
preprints and unpublished papers; telephone conversa- 
tions; personal contact, visits, and telephone or correspon- 
dence contact with major research facilities; and conversa- 
tion, correspondence, or unpublished papers as a source of 
recent useful information. "Impersonal contact" included 
reading journals, using reprints, maintaining contact with 
major research facilities, and presenting papers at formal 
meetings. Results showed interpersonal contacts to be a 
better predictor of productivity than impersonal contacts. 
Thirty-one percent of the variance in productivity was 
accounted for by the predictors in a regression model. 

Academic Rank and Tenure 

Academic rank and tenure are also related to research pro- 
ductivity according to the literature. For example, faculty 
who are in the higher professorial ranks have larger publi- 
cation records than faculty in the lower ranks (Blackburn, 
Behymer, and Hall 1978). This result is to be expected; 
however, it may not be as trivial as it seems. The larger 
question is whether advancement in rank is an incentive to 
produce scholarly research. Such may be the case; for 
example, when productivity was compared among faculty 
with a similar number of years in higher education, those 
with a higher rank tended to be higher research producers 
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than those wich a lower rank (Creswell, Patterson, and 
Parnes 1984a). Whether academic rank causes high pro- 
du tivity or vice versa is an open question (Wanner, 
Lewis, and Gregorio 1981). Because of the unclear causal 
direction between rank and productivity, researchers may 
need to hold academic rank constant in studies and use it 
as a controlled or mediating variable. 

Whereas academic rank is highly related to productivity, 
tenure appears to exorcise little influence on performance 
levels. In a study of sociologists, Holley (1977) found a 
posttenure falloff in research output for faculty, regardless 
of institutional affiliation. In a study of four departments 
(physics, chemistry, sociology, and political science), Neu- 
mann (1979) discovered little difference in publication rates 
between U nured and nontenured faculty, the ugh the differ- 
ences were apparent in distinguished departments. Black- 
burn, Behymer, and Hall (1978) concluded that few errors 
will be made in granting tenure to productive faculty. In 
addition, tenure may not be m incentive to publish. 

Early Productivity 

Productivity early in a faculty member's career is an excel- 
lent predictor of later productivity. One measure of early 
productivity is the chronological age at the time of first 
publication. In a study of Ph.D.'s in sociology, Clemente 
(1973) ; dent-_ied a high negative association between age of 
first p plication and number of articles and books pub- 
lished. Meltzer (194* -50) also established a high negative 
association between age at time of first publication and a 
weighted index of publication counts. These studies, along 
with comments by Manis (1951), suggest that high produc- 
ers start publishing early in their careers. 

A second measure of early publications is the productiv- 
ity of scholars in the first few years after they receive their 
doctorate. Lightfield (1971) determined that sociologists 
who weiv highly published and cited during the first five 
years folic wing receipt of their doctorate continued to pub- 
lish during a second five-year period. For chemists, Reskii 
(1979) established f hat early high research performance, 
measured by the number Particles published during the 
third, fourth, and fifth ye* .s after the Ph.D., was highly 
predictive of the number of published articles after 10 
years (decade publications). She attributed this result to 
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the impact of a high-quality Ph.D. department as well as to 
such material factors as employment settings and access to 
resources. Stephen and Jonathan Cole (1967) established 
that few physicists who start their careers slowly as pro- 
ducers ever become highly productive during theii prof; 
sional life. 

One surrogate measure of early productivity can be 
"prior productivity," defined a« the number of publica- 
tions in the two years prior lo collecting data from faculty 
a'>out their publications (31ackburn, Behymer, and Hall 
19/8). In a national sample of faculty, Blackburn, Behy- 
mer, and Hall (1978) found that two-year performance was 
an excellent predictor of total career articles, thus confirm- 
ing thai high producers continue to publish throughout 
their careers. 

Preference for R "search 

Productive researchers are committed to and prefer 
research to teaching or other activities. Blackburn, Behy- 
mer, and Hall (1978) concluded that when the effects of 
academic discipline and rank were controlled, preference 
for research em<= ^ed as the strongest predictor of total 
journal-article produc ivity over a caieer. Faculty who 
were intrinsically motivated, successful, and sincerely 
invested in research were the high performers. In con- 
trast to medium or low performers, these high performers 
continued to publish throughout their careers, and their 
interest in research also remained constant. 

Crcswell, Barnes, and Wendel (1982) identified primary 
interest in re^aich (as opposed to teaching) as the strong- 
est predictor of journal-article productivity in a battery of 
2b correlates. Their correlation matrix also showed a high 
relationship between interest in research and institutional 
affiliation (r = .25) and weekly hours spent on research 
(r = .68). Thus, individuals who indicated a strong prefer- 
ence for research were employed in institutions that both 
: warded resear^ and encouraged it through released 
time. However, because preference for research correlates 
positively with other variables, its precise impact on per- 
formance is u jertain. Its influence may be indirect. 
Whether a prefe r ence for research causes high perfor- 
mance or high performance causes the preference needs 
further examination. 
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Disciplinary Differences 

The correlate studies that use the disciplinary affiliation of 
faculty in the analyses address two concerns: whether 
research performance differs for faculty from d\iierent dis- 
ciplines, and whether disciplinary affiliation predicts 
research productivity. 

Conclusive evidence shows that faculty research differs 
among the disciplines. For example, Wanner, Lewis, and 
Gregono (1981) compared productivity variables for three 
disciplinary categories: natural sciences, social sciences, 
and humanities. They rank-ordered the disciplines from the 
largest to the smallest output. Natural scientists produced 
the most journal articles, followed by social scientists and 
humanities faculty. For book publications, the social scien- 
tists were the mobt prolific publishers, followed by humani- 
ties faculty and natural scientists. Thus, the norms regard- 
ing productivity emphasize the importance of writing 
books in the humanities and journal articles in the natural 
sciences. Biglan (1973) documented this trend with his find- 
ing that scholars in the "hard' 1 area (e.g., chemistry) pro- 
duced more journal articles than scholars in the "soft" 
area (e.g., accounting), whereas faculty in the "soft' 1 area 
produced more monographs and books than facui y in the 
"hard" area. 

Though research productivity differs among disciplines, 
membership in a discipline is not a strong predictor of 
research performance. In one study, disciplinary member- 
ship explains little of the overall variance in journal-article 
and book productivity when compared with other factors 
(Creswell, Barnes, and Wendel 1982). Disciplinary mem- 
bership, though, may exercise an indirect inluence on 
research performance. The ca »sal path may be that 
research processes and cognitive structures cause differ- 
ences among disciplines that influence performance. Har- 
gens (1975) found th; level of "routinism" differed among 
638 mathematicians, chemists, and political scientists. 
Chemists exhiuited a high degree of "routinism" in that 
they encountered fewer barriers to their progress on 
research than did mathematicians. Chemists also collabo- 
rated more, worked with more graduate students, *nd were 
less apt to be distracted from their research than political 
scientists and mathematicians. In another study, Bayer and 
Dutton (1977) established different aging and research- 
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performance trends for faculty in seven disciplines. Wan- 
ner, Lewis, and Gregorio (i98 1) confirmed that the number 
of journals in different disciplines influenced the number of 
publications for individual faculty. Biglan (1973) showed 
thai .membership in a highly codified discipline influences 
social connectedness (i.e., collaboration). This, in turn, 
permits greater productivity because research problems 
can be subdivided with confidence that the results for each 
part can be reintegrated (Biglan 1973). 

Summary and General Observations 

Numerous studies examine correlates likely to influen a 
faculty lesearch productivity. No single study incorporates 
all possible correlates, but major correlates studied 
include: intelligence tesi scores, motivation, personality 
characteristics, stress, age, gender, prestige of doctoral 
program and mentoring, prestige of employing institution, 
resources and assignment, colleagues, rank and tenure, 
early productivity, preference for research, and disciplin- 
ary differences. 

The studies reviewed suggest several important observa- 
tions: 

First, the predictive power of a correlate is largely a 
function of the criterion measure of performance. For 
example, those correlates that influence journal-article 
productivity differ trom those that affect book productiv- 
ity. Wanner, Lewis, and Gregorio (1981) found that weekly 
time at research, institutional quality, and number of grants 
predict the production of journal articles but not books. 
Creswell, Barnes, and Wendel (1982) established that pref- 
erence for research predicted journal-article productivity 
but not book productivity. 

Second, evidence suggests that psychological and indi- 
vidual correlates (e.g., intelligence scores) hold less 
explanatory power regarding performance than sociological 
and work-environment correlates (e.g., prestige of employ- 
ing institution) (Blackburn and Havighurst 1979). Psycho- 
logical measures, however, suffer from imprecise measure- 
ment and insufficient tests. Sociological measures, such as 
preference for research, time spent on research, and early 
productivity, are extensively discussed in the litertfure. 

Third, a complete explanation for why some faculty are 
high research producers and others are not is not available. 
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But multivariate analyses have explained as much as 60 
percent of the variance in journal-article productivity 
(Blackburn, Behymer, and Hall 1978). in multivariate anal- 
yses of national faculty data, significant correlates of 
journal-art ick and book counts were employment in a 
high-quality institution, discipline, academic; rank, a prefer- 
ence for and time for research, and early prior productivity 
(Blackburn, Behymer, and Hall 1978; Creswell, Barnes, 
ard Wendel 1982; and Wanner, Lewis, and Gregorio 1981). 
These correlates are generally consistent with a composite 
portrait of the productive researcher advanced by Finkel- 
stein (1984, p. 98): 

• holds the doctorate; 

• is strongly oriented toward research; 

• began publishing early, perhaps prior to receipt of the 
doctorate and received ''recognition" for scholarly 
contributions (Cole, J. and Cole, S. 1973; Reskin, 
1977); 

• is in close contact with developments in his or her 
field via interaction with colleagues and keeping 
abreast of the literature; and 

• spends more time in research, less time in teaching, 
and is not overly committed to administrative chores 
(although this may vary over institutional prestige 
strata; see Fulton and Trow 1974). 

Fourth, unclear interaction effects and causality cloud 
the precise relationship between some correlates and pro- 
ductivity. Age. disciplinary membership, and institutional 
affiliation exercise a mediating influence on research per- 
formance. A preference for research may cause high per- 
formance as well as result from it. In sum, research perfor- 
mance is a product of a complex set of correlates. Unfortu- 
nately, the complete causal model has yet to be specified 
and solving the "productivity puzzle 11 eludes researchers 
(Cole, J and ZMckerman 1984). 
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IMPLICATIONS FOR PRACTICE AND FUTURE RESEARCH 



Faa>ny concern for increasing their skill in research and 
scholarship seems to be particularly acute at this time. 
This probably reflects both a natural desire on the part 
of faculty to broaden their professional lives as well as a 
realistic response to changing pressures within their 
institutional reward structures (Blackburn et al. 1980, 



Assuming that faculty seek to enhance their skills in 
research and scholarship, what are the implications for 
practice of the literature on research performance (mea- 
sures, exolanations, and correlates)? Any relationship 
between performance studies and practice is uncharted ter- 
ritory. Though writers have not addressed the implications, 
two are mapped in this section: the implications of the pro- 
ductivity literature for faculty research development and 
for the evaluation of faculty rese ireh performance. Follow- 
ing this discussion, several themes for future scholarly 
investigation are addressed. 

Faculty Research Development 

How do faculty develop as researchers 9 The most obvious 
answer is through graduate programs that train them and 
socialize them to perform research. However, this answer 
is unsatisfactory because skills learned in graduate school 
may wane through disuse. Another answer is throuy/i a 
reward system that pressures faculty to publish and write 
to be promoted and tenured. However, empirical evidence 
suggests that perceived pressure to publish has no indepen- 
dent effect on research productivity (Behyme» 1974). Fac- 
ulty tend to publish because of inner stinuli rather than 
external forces (Pelz and Andrews 1966). Faculty may also 
develop as researchers through self-improvement gained 
by participation in faculty development activities. But not 
all faculty can profit equally from development activities. 
As Fox (1983, p. 229) reported: 

Little can be done to affect the least productive, and 
nothing need be done that could affect t\e most p oduc- 
tive. Howe ver, the scientists in the middle who offer a 
good deal but do not benefit from cumulative advantage 
may be an effective target for efforts to increase both 
opportunity and productivity in science. 



Any 

relationship 
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performance 
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practice is 
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The burden for improved performance clearly remains with 
the faculty, both individually and collectively, though fac- 
ulty initiatives should be tied to institutional missions 
(Kirschling 1979). 

Faculty development consists of "program activities, 
practices, and strategies that aim both to maintain and to 
improve the professional competence of individual fac- 
ulty'' (Mathis 1982, p. 646). Traditionally, faculty develop- 
men* v is emphasized instruction and teaching activities. 
However, the field is in transition from a narrow focus on 
instructional improvement to a broader purpose, including 
organizational development and faculty career develop- 
rr r it (Toombs 1983). Part of faculty career development 
could be "research development," though writers have not 
specified the nature of the activities. Blackburn et al. 
(1980) noted that when faculty were asked about the areas 
in which they needed professional improvement, improve- 
ment in teaching ranked first, but research-oriented activi- 
ties — manuscript preparation and publication, proposal 
writing, and computer use — ranked second, third, and 
fourth in universities and received modesi support in lib- 
eral arts colleges. 

Traditional faculty development activities include some 
research activities. Among faculty development strategies 
for research, Ga'F(1975) listed sabbatical leaves, travel to 
meetings of proxies sional associations, and research sup- 
port. Toombs (1975) argued that the professional develop- 
ment of faculty should include secretarial and technical-aid 
support, as well as equipment and funds for travel. 

The development of faculty as researchers can extend 
beyond these traditional research activities. Faculty can 
improve their own research performance — and be assisted 
by academic administrators — through knowledge of and 
application of the literature on faculty research perfor- 
mance. The correlates discussed earlier can be organized 
into ascriptive (givens), individually controlled, and institu- 
tionally controlled factors to provide practical strategies to 
improve faculty research performance (see Table 5). 
Because ascriptive factors are beyond the control of indi- 
viduals and organizations, only individual and institutional 
factors are discussed here. 
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TABLE 5 

ASCRIPTIVE, INDIVIDUALLY CONTROLLED, AND INSTITUTIONALLY 
CONTROLLED FACTORS INFLUENCING RESEARCH PERFORMANCE 

(Givens) 

Ascriptive Factors 

• Sex of individual (gender) 

• Age of a faculty member at a given point in time (chronological age) 

• Intelligence, possibly measured bv standardized intelligence tests or standardized entrance 
tests, e.g., GRE, MAT (I.Q. or aity) 

• Persorality of the individual, e.g. ego-strength, exactness (personality) 

Individually Controlled Factors 

• Quality and prestige of the doctoral program selected at the pre-career stage (doctoral 
program) 

• Interaction with mentors, sponsors, and influential faculty during the doctoral program 
(mentor or sponsorship) 

• Time — number of years of professional experience — when a faculty member's first 
manuscript is accepted for publication (age of first publication) 

• Publications during the first few years of a professional career— typically within the first 
five years (early publication) 

• Continuous productivity during an academic career (prior productivity) 

• Motivation of individual to produce or absence of "hung-up" periods (motivation) 

• Extent to which colleagues regionally or nationaMy are contacted on a regular basis by 
phone or letter (colleagues) 

• Preference for research as opposed to teaching or service that develops through 
reinforcement processes, e.g., acceptance of manuscripts for publication or citations by 
colleagues (preference for research) 

Institutionally Controlled Factors 

• Quality of the institution determined by the quality of faculty hired (prestige of institution) 

• Pace at which faculty are advanced in rank (promoted) and tenured in the institution 
(academic rank, tenure) 

• Institutional resources allocated to research, e.g., computer time, research assistants, 
assignment of faculty time (resources, assignment) 

• Values of research ascribed by individuals m the department, college, or institution 
(colleagues) 



Individually controlled factors 

Faculty can influence their own performance in several 
ways. 

First, advantages initially accrue to high performers dur- 
ing graduate school. Graduate students in prestigious 
departments or institutions can gain an initial advantage in 
establishing a research career by collaborating with distm- 
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guished scientists on research projects (Cameron and 
Blackburn 1981; Crane 1965; Long 1978). 

Second, individuals who produce early in their careers 
become productive researchers throughout their careers 
(Cole, J. and Cole, S. 1973; Lightfield 1971). One author 
even suggests that publications should occur within the 
first five years of receipt of the doctorate (Lightfield 1971). 
Therefore, faculty should make a concerted effort to pub- 
lish soon after graduate school. On securing a first aca- 
demic position, faculty are sometimes diverted from 
research into teaching and service. Even though the 
reward system is based heavily on research, course prepa- 
rations, student advisement, and departmental committees 
consume large amounts of time. Though these activities are 
valuable, they detract from work on manuscripts and from 
the development of the "habit of writing" (Blackburn, 
Behymer, and Hall 1978). New faculty would do well to 
establish this 4 'habit 1 ' early and begin submitting manu- 
scripts within five years of graduation. 

Third, high research producers are individuals who 
maintain a continuous line of research during their careers. 
They continue to produce throughout their careers without 
experiencing a mid-career slump in performance (Creswell, 
Patterson, and Barnes 1984b). This suggests that a distinct 
line of inquiry, lasting five or more years, might be initiated 
by all individuals aspiring to high performance. 

haculty can also expect periods of being 4 •hung-up," 
periods in which a research theme stalls out temporarily. 
In tliese period* , it is important to pursue simultaneous 
projects becausi one project may reach an impasse (Har- 
gens 1978). 

Fourth, it is abo extremely important to maintain 
research contact » with individuals pursuing similar 
research withir and outside one's employing institution 
(Braxton 1983, Finkelstein 1982; Packer, Lingwood, and 
Paisley 1968). contact should be maintained on a continu- 
ous basis through letters, phone calls, and annual confer- 
ences These contacts not only provide encouragement for 
research ideas but also assist in gaining collaboration 
opportunities and appointments to journal editorial boards 
and in achieving a better understanding of the body of liter- 
ature on a subject. 
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Fifth, a reinforcement process occurs through publishing 
manuscripts. Faculty who publish are encouraged to con- 
tinue publishing (Fox 1983). One cannot overestimate the 
importance of being cited for worthwhile publications, 
being contacted for reprints of articles, and being sought 
out by graduate students who seek to replicate or extend 
works. The influence of the printed word is powerful, as 
accomplished researchers can testify. Moreover, publica- 
tions and citations encourage an individual's preference 
and orientation to perform research instead of teaching and 
service. This preference may be further stimulated by the 
institution through assignments to spend time on research 
projects and provision of other resources (Allison and 
Stewart 1974; Knorr et al. 1979). 

Institutionally controlled factors 

Academic administrators and faculty committees can 

enhance the research performance of faculty in several 

ways. 

First, graduate students from prestigious doctoral pro- 
grams are more productive researchers than students from 
less prestigious programs (Crane 1965). Deans and depart- 
mental chairs can seek applicants for positions from presti- 
gious programs by reviewing quality ratings of doctorate- 
granting departments listed in the five-volume Assessment 
of Research-Doctorate Programs in the United States, 
published by the Committee on an Assessment of Quality- 
Related Characteristics of Research-Doctorate Programs in 
the United States (see Webster 1983). Although some insti- 
tutions may not have the resources to hire graduates from 
the best graduate programs, they can attempt to contact 
graduates from outstanding programs. 

Second, obtaining tenure in a department or college does 
not contribute to improved research productivity (Holley 
1977). Thus, no gains are to be made in research perfor- 
mance by tenuring unproductive researchers. On the other 
hand, academic rank is reliably related to high research 
performance (Blackburn, Behymer, and Hall 1978). Fac- 
ulty who are productive researchers seem to be promoted 
faster t % an faculty who are less productive. Therefore, for 
personnel committees to hold all faculty to the same time- 
in-rank guidelines makes little sense, especially for produc- 
tive researchers. 
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Third, to be high research performers, faculty need time 
assigned to their faculty load for research (Allison and 
Stewart 1974). Oddly enough, this simple point is often 
overlooked by faculty and administrators. The time 
assigned need not be excessive. Knorr et al. (1979) main- 
tained that the time should not exceed 80 percent or be less 
than 20 percent; somewhere in the range of 40 percent is 
probably ideal. Adequate computer time, research assis- 
tants, and secretarial services arc other valuable resources 
in a productive research career. 

Ingalls (1982) discussed a research program to increase 
faculty productivity in one small Canadian university. The 
program included the following elements: 

• the creation of an office of research administration and 
the appointment of a director of research and publica- 
tions; 

• the creation of a presidential committee to make rec- 
ommendations on research policy and the allocation of 
internally funded research grants; 

• tit implementation of binng policies intended to 
recruit and retain faculty with either a proven record 
of research productivity or the potential to develop a 
research program; 

• the allocation of funds from the university's operating 
budget to provide seed money to support the research 
of promising scholars; 

• the establishment of a faculty research seminar; 

• the allocation of faculty travel funds on a priority basis 
to those attending conferences to present their 
research findings; ahd 

• the creation of a program of sabbatical leave grants 
(pp. 60-61). 

Fourth, the attitude and atmosphere of a department or 
^oilege are important in stimulating high productivity 
among faculty (McKeachie 1983). Becker (1977, p. 21) 
commented: "Sincerely expressed interest in what the 
researchers are doing, sympathy for their problems, and 
sincere praise for what they feel are breakthroughs they 
have made are bound to encourage further productive 
activity/' 

Appreciative departmental chairs and administrators 
who respect the research performance of faculty provide 
an environment that is stimulating for researchers. Depart- 
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mental chairs can be role models for high research perfor- 
mance, and senior colleagues can collaborate with or assist 
junior faculty in research. Departmental goals and objec- 
tives can be oriented toward research; faculty can share 
outstanding research achievements with colleagues in 
departmental meetings; and lists of publications can be 
developed and updatea annually for departments and col- 
leges. Such efforts attest to a supportive environment in 
which individuals place value on research. 

Faculty Evaluation and Research Productivity 

How does the literature on research productivity assist 
chairs, deans, university-wide administrators, and person- 
nel committees responsible for the evaluation of faculty 
performance? Before answering this question, a brief 
review of the literature on faculty evaluation is helpful. 

Faculty are evaluated to improve their performance; to 
assist personnel decisions, such as promotion, tenure, and 
salary determinations; to guide students in the selection of 
courses and instructors; and to provide data to individuals 
and organizations operating off campus (Seldin 1980). Var- 
ious assessment tools are used to measure faculty perfor- 
mance, su^h as self-appraisal forms, peer-appraisal forms, 
persons ommittee forms, and forms that are used urj- 
versity-wide. Evaluation of research performance is a 
major component of faculty evaluation not only in universi- 
ties but also in state colleges, and more recently, it has 
assumed new importance in liberal arts colleges (Seldin 
U84b). 

The literature on research productivity can inform fac- 
ulty evaluations in several important ways. 

First, a major finding from the productivity literature is 
that research performance varies by discipline and type of 
institution (e.g., Bayer and Detton 1977; Blackburn, Behy- 
mer, and Hall 1978). Thus, it comes as no surprise that 
disciplines and types of institutions (see, e.g., the Carnegie 
Commission on Higher Education 1973) differ in the kinds 
of information used in making promotion, tenure, and sal- 
ary decision*. In a study of the kinds of information used 
by chairs to evaluate iaculty research performance, Centra 
(1977) found three important types of information: the 
number of articles published in quality journals, the num- 
ber of books of which the faculty member is the sole or 
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senior author, and the quality of the ^acuity member's 
research publications as determined by peers at the institu- 
tion. However, the relative weight given to the kinds of 
information differs by academic field and by institution. 
For example, in research universities, faculty research per- 
formance is judged by the number of grants obtained; in 
the social sciences, by articles in quality journals, internal 
and external peer evaluations, and appointments as journal 
editors; in the humanities, books; and in the natural sci- 
ences, a combination of grants, journal publications, and 
citations. Patterns also differed for faculty in doctorate- 
granting and comprehensive universities and colleges. 

The practical implications of these findings are important 
for personnel committees and university administrators 
who review faculty credentials from several departments 
and disciplines. The importance lies in the need to use dis- 
ciplinary, even departmental, standards for assessment 
rather than university-wide procedures. As Roskens (1983, 
p. 292) commented, 

those who advocat subject area standards point out 
that, when a scholar s work is evaluated, those who con- 
duct the evaluation should recognize the value of the 
scholar s activities, since scholarly activities differ 
depending upon the subject area. Consequently, any 
interpretation of faculty evaluation policies should 
reflect these differences, and subject area, not single 
university-wide or single discipline perspectives, should 
be used to reflect that scholarly achievement. . . . 

Assessing the standards applicable at the lowest level in 
an organization is probably a wise procedure for evalua- 
tors. The kinds of irformation used to assess productivity 
and research performance vary from campus to campus. 
And single, statewide standards of performance cannot be 
applied uniformly without a recognition of the diversity of 
institutional measures. 

A second finding from the research literature is that aca- 
demics' attitudes and performance differ at vanous stages 
in their research careers (e.g., Baldwin 1979; Fulton and 
Trow 1974). For example, mean ratings of the following 
decline during a career: comfort with research scholarship; 
research competence and involvement as a major profes- 



sional strength; and pleasure at the opportunities for 
research, scholarship, and growth and development (Bald- 
win and Blackburn 1981). With this information as a guide, 
those responsible for faculty evaluation should emphasize 
the "developmental" aspect of the academic career, 
acknowledging the changes and fluctuations in the attitudes 
and interests of faculty (Baldwin and Blackburn 1981). 
Such an emphasis will help college administrators and indi- 
vidual professors to understand the attitudes that are domi- 
nant at different times in a career. 

Departmental or college reward systems based heavily 
on research performance for senior faculty overlook ihe 
strong teaching orientation that pervades the near- 
retirement phase of a career. To expect a senior professor 
who has never published to start publishing late in his or 
her career creates an impossible task for that teacher and a 
frustrating experience for faculty evaluators. 

Third, the following are useful generalizations for per- 
sonnel committees: 

• Since research performance is a multidimensional con- 
cept, personnel committees should use several mea- 
sures of performance (Yuker, 1978). 

• When publication and citation counts are used, per- 
sonnel committees should recognize their strengths 
and weaknesses. For example, when publication 
counts are used, it is helpful to assess the quality of 
the journal or book Jauch and Glueck (1975), for 
example, recommended that the best approach is the 
use of simple counts of articles modified by weighting 
the count by a quality-journal index. This index can be 
prepared by faculty most familiar with the quality 
journals (e.g., departmental faculty), though Jauch and 
Glueck realized that obtaining faculty agreement on 
the quality journals might be difficult. 

• Personnel committees might consider a broad defini- 
tion of research and identify levels of acceptable per- 
formance. Centra (1976), Jauch and Glueck (1975), 
and Seldin (1984a) provided a starting point, and their 
measures can be aggregated into quantitative, qualita- 
tive, peer-judgment, and eminence categories, as 
shown in Table 6. Other measures may also be consid- 
ered because of disciplinary orientations, such as 
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TABLE 6 

MEASURES OF RESEARCH IN FACULTY EVALUATION STUDIES 
Jauch and Glueck (1975) Centra (1976); Seldin (1984a) 

Quantitative Measures 

Number of papers, books, and technical Publications in all pi ofessional journals, 

reports published; number of papers papers a f orofessional meetings; books, 

presented at p. ofessional meetings sole or senior author; books, junior 

author or editor; monographs or chapters 
in books; grants or funding received; 
unpublished papers or reports 

Qualitative Measures 

Index of journal quality; citations to Articles in quality journals; citations to 

published materials; success rate of published materials 

proposals for research support 

Peer Judgments 

Peer evaluations; self-evaluations Peers at institution; peers at other 

institutions; self-evaluation; departmental 
chairs: deans 

Eminence Measures 

Referee or editor of scientific journal; Referee o; editor of scientific journal; 

recognition- honors and awards from honors or awards from profession 

profession; officer of national 
professional association; invited papers 
and guest lectures; number of 
dissertations supervised 

patents new methods developed for industry, and cre- 
ative productions. Personnel committers must first 
understand research as it is defined in units and then 
identify acceptable levels of high performance. 

• The lines between scholarship and teaching or service, 
for example, are becoming increasingly blurred (Brax- 
ton aiid Toombs 1982; Pellino, Blackburn and Boberg 
1984). Personnel committees must keep in mind that 
some faculty view research teaching, and service as 
^scholarship' 1 activities. Thus, even faculty who do 

r publish may Jtill perceive their work to be schol- 
arly (Pellino, Blackburn and Boberg 1984). 

• Finally, personnel committees can issue research per- 
formance guiaelii es for new faculty, chairs, and deans 
that are consistent with the mission of the college and 
institution. As Seldin (1980) recommended, personal 
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committees should make known their preferences and 
how the* wt gh research. Personnel committees can 
assign weights to different research products (e.g., 
grants, books, articles, and so forth). Becker (1977) 
reminded us that faculty are responsible for the choice 
of products; once researchers develop their plans, the 
leadership should support such plans through collegial 
assistance and help elaborate those plans into refined 
research proposals consistent with organizational 
directions. 

Research Agendas 

This synthesis of the literature raises questions for future 
scholarly investigation. 

^he measures of research productivity in empirical 
investigations are excessivelv narrow. Beyond publication 
and citation counts, researchers employ few measures. 
Yet, the criteria used to assess research performance vary 
widely from one type of institution to another. Empirical 
studies should examine broader measures of research (e.g., 
grains obtained, patents, creative projects, and others) and 
determine the correlates that have positive predictive influ- 
ence. 

An interdisciplinary approach is needed to study faculty 
research performance. The conceptual basis for this recom- 
mendation is not drawn simply from the sociology of sci- 
ence or from psychology, but also from adult and occupa- 
tional development theories and the history and evolution 
of science. As Fox (1983) commented, the challenge for 
productivity studies lies in the capacity of scholars to com- 
bine perspectives. This means that scholars must cress 
strict discip nary lines to study and explain high perfor- 
mance. Though as much as 60 percent of the variance in 
productivity is explained in some studies, understanding 
high scholarly performance is far from complete. 

More studies should address the correlates of the work 
environment. Because colleagues, resources, time for 
research, and even a suppose environment are crucial 
for high performance, su« tie socialization processes are 
also operative, as well as specific reward systems of insti- 
tutions (such as how merit pay is tied to research perfor- 
mance in a given institution). Unfortunately, knowledge 
about the exact impact of the work environment on indi- 



Faculty R search Performance 55 



ERJ.C 




vidual research performance is limited. Researchers might 
consider using academic rank, discipline, institutional affili- 
ation, and perhaps even career stages (i.e., years of profes- 
sional experience in higher education) as control variables 
in a predictive model and examine closeh the significant 
correlates of productivity that are related to the work envi- 
ronment of the scholar. 

More attention should be given to the relationship between 
faculty career stages and research performance. No clear 
consensus exists as to whether productivity increases, 
remains stable, fluctuates, or declines as faculty age. Per- 
haps all age curves are valid given certain dependent mea- 
sures, and research is needed tc establish ihe measures and 
conditions under which cue curve rather than another 
operates. Also, attaching curves to changes in personal life 
and occupation is an elusive but necessary area for future 
research. An interdisciplinary team drawn from develop- 
mental psychology, psychology, and sociology should 
probe this area. 

Most studies of research productivity are devoid of prac- 
tical suggestions for personnel employed in institutions of 
higher education. One noticeable lack is faculty develop- 
ment. Current and past faculty development studies 
emphasize the development of teaching skills to the exclu- 
sion of development of research skills. Studies should relate 
the development of faculty as researchers to career or devel- 
opmental stages. For example, what assistance does the 
assistant professor with five years experience need to pre- 
pare for rromotion and tenure review? How do the activi- 
ties of ^ professors with 10 years left until retirement 
relate to research development activities? Given the 
increased emphasis on research, questions and activities 
bearing on faculty research development should be widely 
discussed in the coming decade in order to make our 
understanding of faculty research efforts more precise. 

Summary 

The research performance literature can inform faculty and 
academic administrators about strategies for developing 
faculty -,s researchers and for evaluating faculty research 
performance. For faculty development, in addition to tradi- 
tional sabbatical leaves, attendance at professional associa- 
tion meetings, and research monies, the performance liter- 
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ature offers several strategies for improvec .^alty produc- 
tivity. Faculty can select outstanding graduate programs 
for their training, begin publishing soon after achieving the 
doctorate, maintain a continuous level of research through- 
out their careers, keep in continuous contact with other 
scholars working Dn similar research projects, and estab- 
lish a preference for research (e.g., set priorities for 
research activities) in their work schedule. Administrators 
and faculty committees can reinforce and stimulate faculty 
research efforts by employing graduates of research- 
oriented institutions, granting promotions and tenure to 
faculty who are productive researchers, providing faculty 
with time and resources to conduct scholarly work, and" 
creating an attitude and atmosphere in a department or col- 
lege that values research. 

In the faculty evaluation process, those who evaluate 
faculty should realize that research performance varies by 
discipline and that university- or coilege-wide standards 
are inappropriate to assess productivity. Research perfor- 
mance also varies with the stages of a faculty career. Eval- 
uation committees might consider performance levels in 
coryunction with the academic rank and years of experi- 
ence of faculty. Committees can also recognize that seveia! 
measures of research performance should be assessed and 
acknowledge the strengths and limitations of publication 
and citation counts. When publication counts are used to 
evaluate performance, those counts can be supplemented 
by a qualitative index of the publications. Regardless of the 
measures used, faculty and administrators should recog- 
nize that the meaning of scholarship and research *s chang- 
ing in higher education, and new faculty, deans, and evalu- 
ation committees must be informed of changing administra- 
tive practices in various units of the institution. 

Finally, the literature on scholarly productivity suggests 
several future research themes. Future scholarly studies 
should include multiple measures of research productivity 
as dependent variables; utilize an interdisciplinary 
approach to conceptual explanations; examine the impor- 
tance of the work environment on productivity holding 
constant such factors as academic rank, institution, disci- 
pline, and career stage; and suggect practical implications 
of the results for faculty and administrators in higher edu- 
cation. 
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